-- Logs begin at Wed 2022-08-24 17:01:17 UTC, end at Wed 2022-08-24 18:04:11 UTC. -- Aug 24 17:31:59.897649 dv-cinder-835384-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:31:59.906731 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:31:59 2022] *** Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: nodename: dv-cinder-835384-24-iscsi Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: machine: x86_64 Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: clock source: unix Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: pcre jit disabled Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: detected number of CPU cores: 4 Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: current working directory: / Aug 24 17:31:59.908738 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: your processes number limit is 47680 Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: your memory page size is 4096 bytes Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: detected max file descriptor number: 2048 Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: lock engine: pthread robust mutexes Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: thunder lock: enabled Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:31:59.909350 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:31:59.948678 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: Python main interpreter initialized at 0x5625dc0479c0 Aug 24 17:31:59.948678 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: python threads support enabled Aug 24 17:31:59.948678 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: your server socket listen backlog is limited to 100 connections Aug 24 17:31:59.948678 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:31:59.949019 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:31:59.949098 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: *** Operational MODE: preforking *** Aug 24 17:31:59.949335 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:31:59.949335 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: spawned uWSGI master process (pid: 112224) Aug 24 17:31:59.949519 dv-cinder-835384-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:31:59.952592 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: spawned uWSGI worker 1 (pid: 112225, cores: 1) Aug 24 17:31:59.952592 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: spawned uWSGI worker 2 (pid: 112226, cores: 1) Aug 24 17:31:59.952592 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:32:00.604441 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:32:00.621995 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:32:01.677887 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:32:01.677887 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: from cryptography.utils import int_from_bytes Aug 24 17:32:01.678478 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:32:01.678478 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: from cryptography.utils import int_from_bytes Aug 24 17:32:01.687224 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:32:01.687224 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: from cryptography.utils import int_from_bytes Aug 24 17:32:01.687681 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:32:01.687681 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: from cryptography.utils import int_from_bytes Aug 24 17:32:04.154275 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:32:04.154823 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:32:04.155035 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:32:04.155395 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:32:04.155649 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:32:04.156034 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.156355 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.156696 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.157014 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.157232 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:32:04.157582 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.157678 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:32:04.157763 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.157937 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.158028 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:32:04.158252 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.158349 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:32:04.158576 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.158670 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:32:04.158831 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.158960 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159141 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159288 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159466 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-24-iscsi {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159611 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159784 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.159932 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160087 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160263 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160393 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160594 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160728 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.160920 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161028 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161241 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161328 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161568 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161663 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.161822 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162104 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162249 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162444 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-24-iscsi {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162576 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162767 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.162887 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163070 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163184 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163380 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163501 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163696 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.163850 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164005 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164138 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164315 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164448 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164645 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164794 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.164964 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165145 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165284 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165457 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165639 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-24-iscsi {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165784 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.165951 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166077 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166257 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166398 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166563 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166680 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.166963 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167085 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167266 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167569 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167694 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.167882 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168007 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168187 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168311 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168489 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168649 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-24-iscsi {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168838 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.168964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.169154 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.169762 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170025 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170269 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170437 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170592 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170748 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.170874 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171082 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171213 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171365 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171491 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171685 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171825 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.171992 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172117 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172317 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172443 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172597 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172738 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.172944 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173070 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173200 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173322 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173502 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173638 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173820 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.173951 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174071 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174193 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174326 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174450 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174599 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174725 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.174915 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175043 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175219 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175346 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175522 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175696 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175825 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.175947 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176110 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176247 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176410 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176536 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176729 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.176868 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177002 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177125 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177279 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177405 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177599 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177735 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.177905 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178037 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178209 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178334 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178509 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178633 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178812 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.178936 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179115 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179242 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179418 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179545 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179719 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.179836 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180020 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180159 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180336 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180463 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180670 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180796 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.180986 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181130 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181292 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181415 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181594 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181724 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.181895 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182034 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182196 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182329 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182512 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182645 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182841 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.182988 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183309 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183438 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183561 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183681 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.183936 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184064 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184229 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184356 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184528 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184704 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184834 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.184991 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.185703 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.185833 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186004 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186142 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186305 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186440 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186607 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186818 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.186961 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187084 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187205 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187325 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187480 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187606 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187779 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.187914 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188079 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188205 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188380 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188513 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188705 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.188841 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189013 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189138 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189319 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189453 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189617 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189741 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.189917 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190049 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190219 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190351 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190516 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190654 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190820 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.190943 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191117 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191253 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191418 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191549 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191728 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.191852 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192027 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192161 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192324 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192450 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192633 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192766 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.192940 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193076 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193252 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193383 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193563 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193655 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193857 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.193958 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194160 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194300 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194603 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194769 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.194904 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195065 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195189 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195362 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195487 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195659 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195794 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.195956 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196082 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196254 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196380 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196588 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196738 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196863 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.196985 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197149 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197276 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197481 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197606 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197755 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.197879 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198054 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198185 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198351 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198476 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198645 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198777 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.198943 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.199068 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.199244 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.199371 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.199546 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.199680 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.199845 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.199985 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.200160 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.200285 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.200479 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.200620 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.200832 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.200970 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.201165 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.201292 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.201421 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.201543 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.201729 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:32:04.201865 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202060 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202188 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202368 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202493 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202674 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.202979 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203105 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203292 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203496 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203631 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203754 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.203914 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204041 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204227 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204347 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204537 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204700 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.204885 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205009 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205199 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205338 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205511 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205638 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205850 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.205981 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206141 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206275 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206445 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206563 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206772 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.206895 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207089 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207216 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207400 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207526 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207715 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.207842 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208026 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208150 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208334 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208462 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208652 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208777 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.208960 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209100 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209276 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209414 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209606 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209731 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.209916 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210050 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210234 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210362 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210540 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210667 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210847 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.210982 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211170 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211299 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211457 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211583 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211763 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.211896 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212085 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212219 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212393 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212517 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212730 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.212858 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213040 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213166 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213352 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213502 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213707 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213836 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.213958 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214087 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214238 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214364 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214538 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214664 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214837 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.214964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215137 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215263 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215441 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215568 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215741 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.215867 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216054 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216201 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216387 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216513 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216723 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.216864 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217035 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217170 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217337 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217468 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217639 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217762 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.217940 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218073 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218246 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218371 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218544 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218669 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218850 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.218987 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219156 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219282 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219456 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219583 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219773 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.219975 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220101 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220221 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220371 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220494 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220706 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.220833 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221006 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221130 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221306 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221440 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221615 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221747 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.221917 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222043 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222221 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222345 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222523 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222648 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222831 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.222958 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223134 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223259 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223443 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223568 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223753 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.223880 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224058 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224166 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224374 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224492 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224701 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.224836 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225010 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225148 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225321 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225447 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225630 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225760 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.225929 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226064 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226236 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226370 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226536 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226662 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226837 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.226977 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227139 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227272 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227444 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227571 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227741 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.227876 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228039 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228165 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228339 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228466 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228662 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228791 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.228962 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229088 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229280 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229408 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229581 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229707 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.229877 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230001 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230180 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230314 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230480 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230605 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230784 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.230911 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.231089 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.231225 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.231393 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.231520 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.231695 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.232358 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.232556 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.232698 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.232878 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233004 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233184 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233309 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233492 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233636 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233792 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.233993 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234132 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234258 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234380 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234511 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234681 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234801 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.234993 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235119 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235298 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235434 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235610 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235737 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.235916 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236050 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236235 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236362 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236539 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236720 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.236876 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237002 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237178 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237317 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237486 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237610 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237807 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.237941 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238117 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238252 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238430 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238554 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238737 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.238871 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.239042 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.239166 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.239351 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.239723 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.239911 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240050 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240214 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240347 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240515 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240653 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240846 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.240985 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241159 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241293 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241463 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241582 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241776 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.241915 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242079 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242205 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242397 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242524 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242701 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.242835 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243010 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243135 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243305 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243429 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243612 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243746 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.243926 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244124 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244250 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244380 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244539 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244691 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.244869 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245002 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245179 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245311 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245483 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245609 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245786 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.245912 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246088 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246213 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246383 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246508 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246680 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246817 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.246983 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.247118 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.247289 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.247476 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248133 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248260 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248439 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248605 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248765 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.248893 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249075 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249208 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249377 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249584 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249716 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249837 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.249959 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250078 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250253 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250388 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250561 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250686 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250863 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.250988 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251169 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251294 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251472 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251607 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251768 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.251893 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252067 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252195 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252366 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252491 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252691 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252818 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.252989 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253114 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253287 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253414 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253585 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253711 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.253914 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254039 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254251 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254377 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254499 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254628 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254792 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.254927 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255104 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255226 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255393 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255699 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255824 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.255999 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256124 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256298 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256436 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256632 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256760 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.256944 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257087 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257249 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257382 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257549 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257673 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257854 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.257980 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258157 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258292 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258461 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258595 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258766 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.258891 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259066 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259191 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259368 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259502 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259669 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259796 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.259969 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260104 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260274 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260398 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260599 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260738 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.260911 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261157 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261284 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261485 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261619 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261796 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.261924 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262109 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262236 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262413 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262537 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262716 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.262844 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263044 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263174 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263366 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263493 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263692 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.263926 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264064 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264262 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264378 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264588 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264687 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264892 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.264989 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265197 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265332 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265496 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265624 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265793 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.265927 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266091 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266218 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266393 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266520 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266690 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266830 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.266985 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267120 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267280 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267414 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267578 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267713 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.267883 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268010 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268181 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268308 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268486 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268648 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268811 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.268938 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269117 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269241 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269419 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269552 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269719 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.269844 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270019 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270143 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270316 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270445 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270624 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270749 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.270928 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271056 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271237 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271366 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271542 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271669 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271864 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.271990 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.272172 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.272307 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.272470 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.272634 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.272797 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273004 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273129 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273251 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273394 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273528 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273693 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273828 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.273999 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274125 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274303 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274505 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274642 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274775 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.274898 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275019 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275184 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275303 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275490 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275618 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275793 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.275919 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276091 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276218 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276395 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276522 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276719 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.276848 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277030 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277157 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277333 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277461 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277633 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277769 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.277929 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278056 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278234 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278359 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278532 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278675 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278857 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.278993 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279160 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279286 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279458 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279584 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279768 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.279908 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280071 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280203 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280371 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280495 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280691 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280831 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.280998 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281132 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281301 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281427 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281599 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281735 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.281903 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282028 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282203 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282329 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282502 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282637 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282799 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.282926 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283099 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283224 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283394 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283526 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283692 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283818 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.283996 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284121 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284301 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284428 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284643 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284780 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.284910 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285035 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285213 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285341 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285510 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285637 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285806 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.285946 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286104 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286240 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286403 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286527 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286695 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286827 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.286989 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287117 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287284 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287410 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287580 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287715 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.287875 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288002 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288190 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288315 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288490 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288661 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288812 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.288939 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289109 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289236 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289405 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289703 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.289828 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290006 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290132 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290310 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290437 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290613 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290742 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.290934 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291061 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291242 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291370 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291545 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291670 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291845 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.291971 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292146 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292273 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292443 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292599 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292778 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.292916 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293087 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293222 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293462 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293591 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293714 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293854 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.293979 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.294100 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.294272 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.294970 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295097 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295228 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295376 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295505 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295691 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.295827 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296007 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296143 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296324 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296451 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296641 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296767 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.296939 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297080 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297245 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297370 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297545 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297671 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297847 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.297975 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298149 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298275 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298453 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298589 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.298883 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299060 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299186 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299364 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299490 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299668 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299796 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.299972 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300099 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300273 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300399 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300596 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300726 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.300897 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301023 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301204 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301404 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301530 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301650 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301776 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.301905 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302094 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302226 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302381 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302683 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302817 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.302980 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303117 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303292 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303424 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303594 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303728 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.303918 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304054 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304227 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304354 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304530 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.304859 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305001 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305189 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305322 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305451 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305572 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305745 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.305871 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306152 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306283 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306458 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306584 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306761 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.306887 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307063 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307187 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307358 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307481 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307657 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307810 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.307948 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308073 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308262 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308398 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308571 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308700 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.308882 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309020 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309317 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309497 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309624 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309795 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.309940 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.310672 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.310816 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311019 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311144 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311330 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311456 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311652 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311788 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.311958 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312084 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312261 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312388 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312577 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312708 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.312904 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313031 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313213 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313341 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313533 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313661 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313860 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.313985 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314170 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314304 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314477 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314605 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314796 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.314922 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315115 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315318 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315470 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315603 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315728 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.315852 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316002 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316137 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316321 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316462 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316661 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316791 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.316970 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317105 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317288 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317423 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317666 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317792 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.317990 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318125 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318293 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318427 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318605 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318730 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.318910 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319037 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319206 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319341 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319506 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319634 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319813 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.319940 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320117 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320258 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320416 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320580 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320762 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.320890 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321064 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321192 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321372 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321499 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321680 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321815 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.321985 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322113 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322287 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322415 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322585 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322713 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.322901 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323042 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323200 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323334 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323517 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323645 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323825 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.323954 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324143 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324278 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324450 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324618 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324774 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.324900 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325079 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325204 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325386 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325511 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325730 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.325828 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326013 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326120 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326310 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326414 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326629 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326717 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.326932 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327026 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327248 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327345 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327551 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327637 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327872 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.327959 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328177 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328270 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328479 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328589 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328810 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.328898 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329116 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329213 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329442 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329536 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329753 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.329839 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330060 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330147 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330361 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330448 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330668 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330757 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.330971 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331067 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331273 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331360 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331575 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331683 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331877 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.331973 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332176 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332271 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332475 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332589 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332801 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.332898 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333118 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333213 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333417 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333736 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.333824 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334037 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334125 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334335 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334430 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334636 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334731 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.334937 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335032 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335241 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335330 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335542 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335629 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335864 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.335949 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336164 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336251 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336478 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336607 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336811 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.336908 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337117 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337205 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337422 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337518 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337725 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.337812 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338029 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338115 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338340 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338427 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338649 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338745 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.338953 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339040 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339263 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339357 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339572 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339669 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339883 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.339976 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.340197 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.340391 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.340509 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.340750 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.340841 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341067 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341163 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341407 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341495 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341721 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.341821 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342033 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342122 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342344 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342445 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342655 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342742 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.342965 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343179 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343274 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343512 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343601 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343832 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.343919 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344151 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344241 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344468 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344584 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344809 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.344899 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345126 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345223 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345434 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345521 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345744 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.345830 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346050 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346144 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346357 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346443 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346690 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346798 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.346993 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347087 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347302 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347403 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347615 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347715 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.347928 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348029 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348232 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348327 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348538 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348645 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348868 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.348958 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349178 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349265 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349485 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349580 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349790 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.349877 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350101 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350188 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350408 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350503 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350717 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.350804 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351029 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351126 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351340 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351435 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351646 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351747 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.351957 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352059 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352263 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352350 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352602 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352796 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.352905 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353105 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353253 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353433 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353527 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353754 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.353843 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354073 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354168 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354384 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354471 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354694 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.354782 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355015 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355120 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355314 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355555 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355644 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355870 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.355965 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.356192 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.356285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.356489 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.356591 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.357344 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.357458 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.357649 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.357737 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.357949 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358036 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358262 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358362 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358565 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358660 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.358868 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359083 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359180 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359422 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359511 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359731 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.359818 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360051 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360151 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360368 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360454 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360702 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.360804 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361007 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361103 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361327 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361414 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361628 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361892 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.361991 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362224 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362311 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362528 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362615 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362826 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.362923 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363125 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363212 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363429 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363733 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.363829 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.364031 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.364127 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.364334 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.364421 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.364914 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365014 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365229 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365315 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365527 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365613 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365827 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.365916 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366126 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366217 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366430 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366516 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366727 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.366815 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367025 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367111 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367323 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367424 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367621 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367709 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.367926 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368013 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368223 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368309 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368525 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368663 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368847 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.368932 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369153 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369241 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369453 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369539 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369753 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.369839 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370053 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370220 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370357 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370444 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370659 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370743 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.370959 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371053 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371266 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371352 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371570 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371656 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371878 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.371973 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.372181 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.372268 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373055 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373149 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373351 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373451 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373681 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.373768 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374044 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374201 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374427 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374523 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374746 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.374832 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375060 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375146 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375383 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375479 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375698 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.375791 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376010 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376104 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376320 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376406 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376638 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376730 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.376946 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377207 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377307 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377545 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377640 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377866 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.377958 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378173 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378268 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378479 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378565 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378787 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.378874 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379108 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379198 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379398 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379485 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379697 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.379783 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380003 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380091 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380313 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380408 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380645 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380742 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.380951 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381036 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381260 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381346 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381575 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381676 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381891 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.381978 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382200 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382292 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382510 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382603 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382817 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.382910 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383122 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383216 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383426 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383522 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383729 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.383824 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384030 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384118 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384341 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384435 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384688 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.384780 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385000 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385088 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385299 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385387 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385620 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385708 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.385938 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386034 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386251 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386339 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386562 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386649 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386873 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.386990 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387183 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387279 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387497 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387584 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387800 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.387899 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388155 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388241 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388463 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388578 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388833 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.388922 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389166 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389254 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389491 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389578 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389812 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.389901 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390114 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390215 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390419 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390507 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390718 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.390807 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391022 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391110 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391333 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391433 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391635 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391724 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.391934 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392022 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392232 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392332 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392536 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392738 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.392859 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393018 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393159 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393327 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393459 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393638 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.393945 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394062 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394255 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394344 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394573 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394660 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394884 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.394979 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395188 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395275 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395486 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395572 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395783 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.395878 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396085 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396210 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396380 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396466 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396704 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.396808 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397001 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397086 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397297 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397384 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397595 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397690 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397895 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.397997 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398199 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398287 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398504 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398593 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398807 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.398900 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399110 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399201 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399418 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399515 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399718 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.399805 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400018 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400105 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400322 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400411 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400650 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400740 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.400953 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401038 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401279 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401415 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401585 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401680 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401889 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.401990 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402193 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402288 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402497 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402592 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402800 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.402894 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403104 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403190 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403408 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403495 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403755 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.403849 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404072 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404207 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404428 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404522 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404743 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.404859 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405055 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405174 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405366 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405485 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405678 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405792 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.405989 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406119 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406299 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406427 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406611 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406717 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.406923 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407010 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407249 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407343 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407557 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407645 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407881 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.407974 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408190 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408284 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408497 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408615 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408835 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.408921 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409145 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409239 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409555 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409792 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.409886 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410078 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410176 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410385 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410485 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410696 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.410793 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411002 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411091 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411316 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411403 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411626 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411713 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.411938 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412027 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412253 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412339 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412578 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412667 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412878 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.412967 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.413117 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:32:04.413213 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.413521 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.413852 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.414179 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.414526 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.414839 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.415183 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.415512 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.415826 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.416138 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:32:04.416716 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:32:04.567612 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO dbcounter [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Registered counter for database nova_api Aug 24 17:32:04.570834 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO dbcounter [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Registered counter for database nova_api Aug 24 17:32:04.587847 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_db.sqlalchemy.engines [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.590484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_db.sqlalchemy.engines [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.595179 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writer thread running {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.597522 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writer thread running {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.650620 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.context [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6f79d34-d459-413a-9a07-4219ab368fd7(cell1) {{(pid=112225) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:32:04.653071 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.context [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6f79d34-d459-413a-9a07-4219ab368fd7(cell1) {{(pid=112226) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:32:04.655354 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:04.655809 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:04.657452 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:04.657695 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:04.657929 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:04.658460 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:04.658912 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:04.659499 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:04.660232 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:04.660705 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:04.661090 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:04.662693 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_concurrency.lockutils [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:04.663343 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO dbcounter [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Registered counter for database nova_cell0 Aug 24 17:32:04.664694 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO dbcounter [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Registered counter for database nova_cell0 Aug 24 17:32:04.668908 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO dbcounter [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Registered counter for database nova_cell1 Aug 24 17:32:04.670712 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO dbcounter [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Registered counter for database nova_cell1 Aug 24 17:32:04.676504 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_db.sqlalchemy.engines [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.680698 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_db.sqlalchemy.engines [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.681803 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_db.sqlalchemy.engines [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.683459 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_db.sqlalchemy.engines [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.688475 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writer thread running {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.688850 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writer thread running {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.689716 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writer thread running {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.691167 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writer thread running {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.833333 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO dbcounter [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Registered counter for database nova_cell0 Aug 24 17:32:04.835259 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO dbcounter [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Registered counter for database nova_cell0 Aug 24 17:32:04.842513 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG oslo_db.sqlalchemy.engines [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.846049 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_db.sqlalchemy.engines [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:32:04.847008 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writer thread running {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:04.850593 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writer thread running {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:32:05.187269 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: WARNING keystonemiddleware.auth_token [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:32:05.194595 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: WARNING keystonemiddleware.auth_token [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:32:05.205633 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: WARNING keystonemiddleware.auth_token [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:32:05.213155 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: WARNING keystonemiddleware.auth_token [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:32:05.536643 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: WARNING keystonemiddleware.auth_token [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:32:05.542576 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: WARNING keystonemiddleware.auth_token [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:32:05.547863 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625dc0479c0 pid: 112225 (default app) Aug 24 17:32:05.549980 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:05.551175 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Aug 24 17:32:05.551585 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Aug 24 17:32:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:32:05.562071 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: WARNING keystonemiddleware.auth_token [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:32:05.568023 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: WARNING keystonemiddleware.auth_token [None req-a739b1df-679c-4eff-8aef-9ccdfb22c2cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:32:05.573300 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625dc0479c0 pid: 112226 (default app) Aug 24 17:33:22.292982 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:22.294171 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Aug 24 17:33:22.295214 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:22.306880 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_api:SELECT=3 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:22.308005 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_cell1:SELECT=3 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:22.308752 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_cell0:SELECT=3 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:22.310201 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:23.181494 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-5640db53-8c37-41a3-9290-837ed7442cf3 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:23.213128 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-5640db53-8c37-41a3-9290-837ed7442cf3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911187 Aug 24 17:33:23.229002 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 17:33:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:25.564426 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:25.565419 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-b38d68fa-88d7-4394-837a-b93f1abe5deb None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 17:33:25.566017 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:25.986498 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-75da4568-99c1-42f3-a17d-0b142a003331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:26.007880 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:33:26.007880 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: warnings.warn(msg) Aug 24 17:33:26.037620 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-75da4568-99c1-42f3-a17d-0b142a003331 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.464837 Aug 24 17:33:26.039573 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:26.255375 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-5c0c1c3d-f17c-47df-8c19-7f329fc8956a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:26.260071 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:33:26.260071 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:33:26.279967 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_api:SELECT=3 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:26.281267 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_cell0:SELECT=3 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:26.282178 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_cell1:SELECT=3 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:26.282964 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:26.340334 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-5c0c1c3d-f17c-47df-8c19-7f329fc8956a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293266 Aug 24 17:33:26.344691 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 17:33:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:28.698600 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-75da4568-99c1-42f3-a17d-0b142a003331 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:28.699626 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-75da4568-99c1-42f3-a17d-0b142a003331 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 17:33:28.700285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:29.387300 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-2cb0d040-d8df-4d55-a648-7fd15736d8ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:29.406849 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:33:29.406849 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:33:29.426377 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-2cb0d040-d8df-4d55-a648-7fd15736d8ef admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.719256 Aug 24 17:33:29.428197 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:29.439969 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-4f604e56-cc10-43e0-8667-07c406292700 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:29.443407 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:33:29.443407 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: warnings.warn(msg) Aug 24 17:33:29.477753 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-4f604e56-cc10-43e0-8667-07c406292700 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041862 Aug 24 17:33:29.485413 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 17:33:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:31.846821 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-2cb0d040-d8df-4d55-a648-7fd15736d8ef admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:31.847846 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-2cb0d040-d8df-4d55-a648-7fd15736d8ef admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 17:33:31.848259 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:32.243726 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-b6799d72-ab75-4245-8347-9ffd4287f831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:32.262490 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-b6799d72-ab75-4245-8347-9ffd4287f831 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408213 Aug 24 17:33:32.263079 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:33:32.275615 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-12554891-57c0-4858-89ec-65b27c3fc2b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:32.299064 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-12554891-57c0-4858-89ec-65b27c3fc2b0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027120 Aug 24 17:33:32.299634 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 17:33:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:34.626693 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-b6799d72-ab75-4245-8347-9ffd4287f831 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:34.627793 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-b6799d72-ab75-4245-8347-9ffd4287f831 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 24 17:33:34.628198 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:35.115800 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-8565d8d1-c9b9-4a79-ac90-f95a54239e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:35.137286 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-8565d8d1-c9b9-4a79-ac90-f95a54239e99 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502596 Aug 24 17:33:35.138765 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:33:35.150624 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-ed61a4bc-63df-4cec-bdcc-c39cfe511202 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:35.176869 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-ed61a4bc-63df-4cec-bdcc-c39cfe511202 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030409 Aug 24 17:33:35.185349 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 17:33:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:37.512422 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-8565d8d1-c9b9-4a79-ac90-f95a54239e99 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:37.513488 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-8565d8d1-c9b9-4a79-ac90-f95a54239e99 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 17:33:37.513889 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:37.955045 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:37.976991 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457016 Aug 24 17:33:37.980581 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:33:37.989770 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-85b8b4bc-f1cb-4e69-b30b-ea964aa937cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:38.016575 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-85b8b4bc-f1cb-4e69-b30b-ea964aa937cf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030378 Aug 24 17:33:38.017873 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 17:33:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:40.467823 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.468989 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Aug 24 17:33:40.469489 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:40.891094 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-f54d9c93-d2f2-4a39-b23f-ad5de6ffe995 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.914945 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-f54d9c93-d2f2-4a39-b23f-ad5de6ffe995 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.439330 Aug 24 17:33:40.915494 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 17:33:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:33:43.237877 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:43.239512 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-55bcb20f-c092-46c1-9dc9-60a174f7c84d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Aug 24 17:33:43.239925 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:43.672300 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-9591ba64-c0ea-4c56-b8f6-d800b563fdd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "swap": 0}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:43.693782 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-9591ba64-c0ea-4c56-b8f6-d800b563fdd1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.446590 Aug 24 17:33:43.694544 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:43.709150 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d73e5be1-751a-4aeb-a52e-ac1702cdbc50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:43.734366 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d73e5be1-751a-4aeb-a52e-ac1702cdbc50 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028935 Aug 24 17:33:43.734944 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 17:33:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:46.036490 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-9591ba64-c0ea-4c56-b8f6-d800b563fdd1 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:46.037555 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-9591ba64-c0ea-4c56-b8f6-d800b563fdd1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 24 17:33:46.038125 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:46.431889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-6f5945ee-2b3c-4ff8-890e-151fbd3e2b50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:46.450687 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-6f5945ee-2b3c-4ff8-890e-151fbd3e2b50 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406819 Aug 24 17:33:46.451268 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:46.463073 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-f5b972d6-c2b7-49fb-82c1-af2f75fd0322 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:46.487356 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-f5b972d6-c2b7-49fb-82c1-af2f75fd0322 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027908 Aug 24 17:33:46.487927 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 17:33:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:48.824863 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-6f5945ee-2b3c-4ff8-890e-151fbd3e2b50 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:48.825908 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-6f5945ee-2b3c-4ff8-890e-151fbd3e2b50 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 17:33:48.826865 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:49.199184 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-37b85996-310e-4a8e-87f5-493256ff1151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:49.218178 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-37b85996-310e-4a8e-87f5-493256ff1151 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385226 Aug 24 17:33:49.219110 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:49.231401 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-53a2a3f7-cabc-4659-8e61-ae3487ac710b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:49.257818 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-53a2a3f7-cabc-4659-8e61-ae3487ac710b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030226 Aug 24 17:33:49.258400 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 17:33:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:51.602341 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-37b85996-310e-4a8e-87f5-493256ff1151 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:51.604093 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-37b85996-310e-4a8e-87f5-493256ff1151 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 24 17:33:51.604760 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:52.074163 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a6fe0d34-7701-40a1-a694-ee3580cb5290 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:52.101340 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a6fe0d34-7701-40a1-a694-ee3580cb5290 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489607 Aug 24 17:33:52.102565 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:52.115293 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-f561ad73-42d7-4a63-94e2-a9c043164b40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:52.145362 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-f561ad73-42d7-4a63-94e2-a9c043164b40 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033656 Aug 24 17:33:52.160724 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 17:33:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:54.547955 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a6fe0d34-7701-40a1-a694-ee3580cb5290 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:54.549648 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a6fe0d34-7701-40a1-a694-ee3580cb5290 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Aug 24 17:33:54.550231 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:55.002676 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:55.022392 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465871 Aug 24 17:33:55.022951 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 17:33:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:55.039378 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-74b3f5a7-dde2-4339-a3a3-5ffa98a4ecc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:55.044186 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:55.070289 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-74b3f5a7-dde2-4339-a3a3-5ffa98a4ecc6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038738 Aug 24 17:33:55.071412 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 17:33:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:14.084896 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:14.085841 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 17:34:14.086274 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:14.466462 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a4a3e737-7dbe-4bfc-9e81-f41c86ed649a admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:14.484221 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a4a3e737-7dbe-4bfc-9e81-f41c86ed649a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.391904 Aug 24 17:34:14.484786 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 17:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:15.531980 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:15.533035 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-8b660324-6bc3-4281-a050-c7efc43a6ba7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 17:34:15.533435 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:16.045285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d0c27ace-9c5a-4bac-895e-b1fc6f3545e0 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:16.050930 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.wsgi [None req-d0c27ace-9c5a-4bac-895e-b1fc6f3545e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d0c27ace-9c5a-4bac-895e-b1fc6f3545e0 admin admin] Request method failure captured: Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept: application/json Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept-Encoding: gzip, deflate Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Connection: keep-alive Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Content-Length: 0 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Host: 10.222.0.45 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-System-Scope: None Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: User-Agent: python-novaclient Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Auth-Token: gAAAAABjBmEXjOW8tLKkv5w5TxdGA6uufluDeJrZbSexNowwFqDTShn_kHk-5Wzt_UUNjJ_QDdu632qtq8PEO2_f3sw9oo3XDSvt_HrcFGkmX_aRd2Qeo63jGKJy22Mst88HnIrzCsHarzbEpX_7j6j1R-38w1WP-P1UUvFgYVvkeFkGMA_UWJg Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Id: None Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Name: None Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Identity-Status: Confirmed Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Is-Admin-Project: True Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Id: default Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Name: Default Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Name: admin Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Role: reader,member,admin Aug 24 17:34:16.054285 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Roles: reader,member,admin Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant: admin Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Name: admin Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User: admin Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Id: default Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Name: Default Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Name: admin Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: method: > Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: exception: Flavor 42 could not be found. Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: action_args: {'id': '42'} Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:16.055879 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:16.056814 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.058518 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d0c27ace-9c5a-4bac-895e-b1fc6f3545e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:16.059772 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d0c27ace-9c5a-4bac-895e-b1fc6f3545e0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386332 Aug 24 17:34:16.059772 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 17:34:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:34:16.065864 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-34ccdd1c-9a79-46fc-8936-814b71879e51 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:16.070166 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:16.089932 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-34ccdd1c-9a79-46fc-8936-814b71879e51 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027649 Aug 24 17:34:16.090482 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:16.100246 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-b0161431-4409-45f2-89c5-fb98d497d453 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:16.124924 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-b0161431-4409-45f2-89c5-fb98d497d453 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028215 Aug 24 17:34:16.125463 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:34:16.135497 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-50864c4e-46c8-4c66-b004-1efcfae5121d admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:16.141933 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.wsgi [None req-50864c4e-46c8-4c66-b004-1efcfae5121d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-50864c4e-46c8-4c66-b004-1efcfae5121d admin admin] Request method failure captured: Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept: application/json Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept-Encoding: gzip, deflate Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Connection: keep-alive Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Content-Length: 0 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Host: 10.222.0.45 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-System-Scope: None Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: User-Agent: python-novaclient Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Auth-Token: gAAAAABjBmEXjOW8tLKkv5w5TxdGA6uufluDeJrZbSexNowwFqDTShn_kHk-5Wzt_UUNjJ_QDdu632qtq8PEO2_f3sw9oo3XDSvt_HrcFGkmX_aRd2Qeo63jGKJy22Mst88HnIrzCsHarzbEpX_7j6j1R-38w1WP-P1UUvFgYVvkeFkGMA_UWJg Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Id: None Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Name: None Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Identity-Status: Confirmed Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Is-Admin-Project: True Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Id: default Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Name: Default Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Name: admin Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Role: reader,member,admin Aug 24 17:34:16.145182 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Roles: reader,member,admin Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant: admin Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Name: admin Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User: admin Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Id: default Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Name: Default Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Name: admin Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: method: > Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: exception: Flavor 42 could not be found. Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: action_args: {'id': '42'} Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:16.146664 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:16.147590 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:16.148867 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-50864c4e-46c8-4c66-b004-1efcfae5121d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:16.150029 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-50864c4e-46c8-4c66-b004-1efcfae5121d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015460 Aug 24 17:34:16.150029 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 17:34:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 17:34:17.102933 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-b0161431-4409-45f2-89c5-fb98d497d453 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:17.104020 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-b0161431-4409-45f2-89c5-fb98d497d453 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 17:34:17.104423 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:17.616594 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-12c459ef-039a-4400-9067-5bfdf33eebdc admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:17.622142 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.wsgi [None req-12c459ef-039a-4400-9067-5bfdf33eebdc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-12c459ef-039a-4400-9067-5bfdf33eebdc admin admin] Request method failure captured: Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept: application/json Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept-Encoding: gzip, deflate Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Connection: keep-alive Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Content-Length: 0 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Host: 10.222.0.45 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-System-Scope: None Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: User-Agent: python-novaclient Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Auth-Token: gAAAAABjBmEZPePMypmntyuB6on3VePGsx0HBh7NRkUJnVk2JnAkQo0qWYZHlZDtSpz66AWrt727MunntcAAU0IhilfnplO6ARvKBtUq503x-F6lozVcF326AkvHQSPgN64MQ2r2A1-4J8lmO1uzUr7sy714ACmRglJztqRR-0K3TSTb76xcT5E Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Id: None Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Name: None Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Identity-Status: Confirmed Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Is-Admin-Project: True Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Id: default Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Name: Default Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Name: admin Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Role: reader,member,admin Aug 24 17:34:17.624255 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Roles: reader,member,admin Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant: admin Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Name: admin Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User: admin Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Id: default Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Name: Default Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Name: admin Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: method: > Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: exception: Flavor 84 could not be found. Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: action_args: {'id': '84'} Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:17.625759 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:17.626700 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.627756 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-12c459ef-039a-4400-9067-5bfdf33eebdc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:17.628777 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-12c459ef-039a-4400-9067-5bfdf33eebdc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.382682 Aug 24 17:34:17.628777 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 17:34:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:34:17.635294 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-6e25ef39-c453-4b33-9e9d-e61dbedfb899 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:17.649811 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-6e25ef39-c453-4b33-9e9d-e61dbedfb899 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018123 Aug 24 17:34:17.650328 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:34:17.659384 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-01cb58f7-8f19-4cd2-9a11-f80eafbe32a9 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:17.676509 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-01cb58f7-8f19-4cd2-9a11-f80eafbe32a9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020566 Aug 24 17:34:17.677055 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:17.686719 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-bc08e7fe-7ea5-4096-be74-b8172eb6f240 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:17.691970 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.wsgi [None req-bc08e7fe-7ea5-4096-be74-b8172eb6f240 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-bc08e7fe-7ea5-4096-be74-b8172eb6f240 admin admin] Request method failure captured: Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept: application/json Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept-Encoding: gzip, deflate Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Connection: keep-alive Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Content-Length: 0 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Host: 10.222.0.45 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-System-Scope: None Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: User-Agent: python-novaclient Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Auth-Token: gAAAAABjBmEZPePMypmntyuB6on3VePGsx0HBh7NRkUJnVk2JnAkQo0qWYZHlZDtSpz66AWrt727MunntcAAU0IhilfnplO6ARvKBtUq503x-F6lozVcF326AkvHQSPgN64MQ2r2A1-4J8lmO1uzUr7sy714ACmRglJztqRR-0K3TSTb76xcT5E Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Id: None Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Name: None Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Identity-Status: Confirmed Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Is-Admin-Project: True Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Id: default Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Name: Default Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Name: admin Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Role: reader,member,admin Aug 24 17:34:17.693519 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Roles: reader,member,admin Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant: admin Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Name: admin Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User: admin Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Id: default Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Name: Default Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Name: admin Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: method: > Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: exception: Flavor 84 could not be found. Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: action_args: {'id': '84'} Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:17.694964 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:17.695966 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:17.697390 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-bc08e7fe-7ea5-4096-be74-b8172eb6f240 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:17.698655 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-bc08e7fe-7ea5-4096-be74-b8172eb6f240 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012243 Aug 24 17:34:17.698655 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 17:34:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 17:34:18.650169 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-01cb58f7-8f19-4cd2-9a11-f80eafbe32a9 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:18.651184 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-01cb58f7-8f19-4cd2-9a11-f80eafbe32a9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 24 17:34:18.651586 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:19.172842 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-77e62d84-aae4-42e7-8ac9-6c265b7c97f6 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.178421 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.wsgi [None req-77e62d84-aae4-42e7-8ac9-6c265b7c97f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-77e62d84-aae4-42e7-8ac9-6c265b7c97f6 admin admin] Request method failure captured: Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept: application/json Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Accept-Encoding: gzip, deflate Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Connection: keep-alive Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Content-Length: 0 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Host: 10.222.0.45 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Openstack-System-Scope: None Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: User-Agent: python-novaclient Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Auth-Token: gAAAAABjBmEai2x65LsccM_4264qxFjjDtqq_T6fJjCO9aOm4abzamn01f1SERVCe_QmLy47TfCyRb8h1jJRbAx4NVdAoGd6d-tDBOAJbvPp28MquMUaAM_LGpt3z-r9ZczBjWZYk7kB7jV4DjHA3X1TPItU9Gm3baMqRg4ob0APwepaDwGIMbY Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Id: None Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Domain-Name: None Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Identity-Status: Confirmed Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Is-Admin-Project: True Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Id: default Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Domain-Name: Default Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Project-Name: admin Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Role: reader,member,admin Aug 24 17:34:19.179889 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Roles: reader,member,admin Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant: admin Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-Tenant-Name: admin Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User: admin Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Id: default Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Domain-Name: Default Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: X-User-Name: admin Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: method: > Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: exception: Flavor 451 could not be found. Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: action_args: {'id': '451'} Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:19.181484 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:19.182532 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.183921 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-77e62d84-aae4-42e7-8ac9-6c265b7c97f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:19.185193 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-77e62d84-aae4-42e7-8ac9-6c265b7c97f6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393166 Aug 24 17:34:19.185193 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:34:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:34:19.191408 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-5d41a118-2c7c-4d6b-94aa-9d48b736a0b2 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.206209 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-5d41a118-2c7c-4d6b-94aa-9d48b736a0b2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018366 Aug 24 17:34:19.206965 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:19.215909 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.230406 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017988 Aug 24 17:34:19.230947 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 17:34:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:19.240192 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-7e78ef49-0181-45d9-86a9-6e9eacfef084 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.245624 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.wsgi [None req-7e78ef49-0181-45d9-86a9-6e9eacfef084 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-7e78ef49-0181-45d9-86a9-6e9eacfef084 admin admin] Request method failure captured: Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept: application/json Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Accept-Encoding: gzip, deflate Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Connection: keep-alive Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Content-Length: 0 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Host: 10.222.0.45 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-Api-Version: compute 2.90 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Openstack-System-Scope: None Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: User-Agent: python-novaclient Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Auth-Token: gAAAAABjBmEai2x65LsccM_4264qxFjjDtqq_T6fJjCO9aOm4abzamn01f1SERVCe_QmLy47TfCyRb8h1jJRbAx4NVdAoGd6d-tDBOAJbvPp28MquMUaAM_LGpt3z-r9ZczBjWZYk7kB7jV4DjHA3X1TPItU9Gm3baMqRg4ob0APwepaDwGIMbY Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Id: None Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Domain-Name: None Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Identity-Status: Confirmed Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Is-Admin-Project: True Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Id: default Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Domain-Name: Default Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Project-Name: admin Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Role: reader,member,admin Aug 24 17:34:19.247103 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Roles: reader,member,admin Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e847003e2ef47df81d36ac4caad47f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant: admin Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Id: 1e847003e2ef47df81d36ac4caad47f0 Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-Tenant-Name: admin Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User: admin Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Id: default Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Domain-Name: Default Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Id: cc2669e1aa494dbcb7164d2e5e46378c Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: X-User-Name: admin Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: method: > Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: exception: Flavor 451 could not be found. Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: action_args: {'id': '451'} Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:19.249215 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:19.250147 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: ERROR nova.api.openstack.wsgi Aug 24 17:34:19.251468 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-7e78ef49-0181-45d9-86a9-6e9eacfef084 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:19.252736 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-7e78ef49-0181-45d9-86a9-6e9eacfef084 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011724 Aug 24 17:34:19.252736 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:34:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:34:20.219609 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:20.220648 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 17:34:20.221046 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:20.733661 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-cbe84db4-655b-43d5-a6c5-29808ed721b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:20.752533 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-cbe84db4-655b-43d5-a6c5-29808ed721b8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.394776 Aug 24 17:34:20.753107 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 17:34:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:34:21.713621 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:21.714629 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 17:34:21.715024 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:22.229858 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-265aad6c-7a69-414b-982e-3b1f11cca9a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:22.247973 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-265aad6c-7a69-414b-982e-3b1f11cca9a5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.394166 Aug 24 17:34:22.248514 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 17:34:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:34:23.203944 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:23.204996 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 24 17:34:23.205410 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:23.729954 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-f7fcc323-7d91-47b5-827a-8ebea353da2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:23.748491 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-f7fcc323-7d91-47b5-827a-8ebea353da2d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406512 Aug 24 17:34:23.749056 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 17:34:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:34:24.715689 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:24.716728 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 24 17:34:24.717152 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:25.240495 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-a07fdce8-d18f-4c4b-a818-651d4fb2f63c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:25.259589 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-a07fdce8-d18f-4c4b-a818-651d4fb2f63c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403971 Aug 24 17:34:25.260164 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 17:34:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:34:26.220700 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:26.221702 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 17:34:26.222097 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:26.743290 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-49e261de-7d97-4093-b1db-e97dbfe8f26c admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:26.764939 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-49e261de-7d97-4093-b1db-e97dbfe8f26c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403881 Aug 24 17:34:26.765475 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Aug 24 17:34:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:35:19.574570 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:19.575585 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-a65def19-a5fa-414d-bccc-3c3bdcbe3473 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 17:35:19.575982 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 17:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:35:19.587006 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:35:19.963375 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-d920491d-2d60-4465-8170-4a265b350fdc admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:19.983965 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-d920491d-2d60-4465-8170-4a265b350fdc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401389 Aug 24 17:35:19.984501 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 17:35:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:35:20.006144 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG dbcounter [-] [112226] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=112226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:35:20.010103 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-aed97e57-7a4c-476a-b88a-47b668734aba admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:20.018315 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-aed97e57-7a4c-476a-b88a-47b668734aba admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013608 Aug 24 17:35:20.018827 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 24 17:35:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:35:20.030273 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-43f0e322-8ce5-4f4d-bb7e-d1488aa8f0d2 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:20.037855 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-43f0e322-8ce5-4f4d-bb7e-d1488aa8f0d2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011133 Aug 24 17:35:20.038366 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 24 17:35:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:35:20.049948 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d97d0890-776d-407d-9321-002f475357df admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:20.057725 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d97d0890-776d-407d-9321-002f475357df admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011213 Aug 24 17:35:20.058599 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 24 17:35:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:35:20.070377 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-4e6f4f2c-2c5c-4a33-8a12-bf311bed2242 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:35:20.077905 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-4e6f4f2c-2c5c-4a33-8a12-bf311bed2242 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010995 Aug 24 17:35:20.078420 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 24 17:35:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:18.356409 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d97d0890-776d-407d-9321-002f475357df admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:18.357467 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d97d0890-776d-407d-9321-002f475357df admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 17:38:18.357861 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:18.497480 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_api:SELECT=6 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:18.654336 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:18.656697 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:38:18.656697 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:38:18.657832 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:18.658303 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:18.658727 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:18.659458 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:18.659894 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:18.660300 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:18.693465 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-6ba3db65-8e7d-4f49-9ae3-16434b088375 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.197480 Aug 24 17:38:18.694015 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:38:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:38:19.518815 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d97d0890-776d-407d-9321-002f475357df admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:19.519829 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d97d0890-776d-407d-9321-002f475357df admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 17:38:19.520223 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:19.709489 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:19.711896 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:38:19.711896 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:38:19.713547 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:19.714017 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:19.714440 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:19.715144 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:19.715583 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:19.715994 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:19.735549 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-ab0b97a8-a2ba-4e28-8968-b53c3808c069 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075915 Aug 24 17:38:19.736092 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:38:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:38:30.965231 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d97d0890-776d-407d-9321-002f475357df admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:30.966257 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d97d0890-776d-407d-9321-002f475357df admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 17:38:30.966642 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:31.109093 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_cell0:SELECT=4 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:31.109737 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_cell1:SELECT=4 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:31.110347 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG dbcounter [-] [112225] Writing DB stats nova_api:SELECT=8 {{(pid=112225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:31.159144 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:31.161564 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:38:31.161564 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:38:31.162729 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:31.163206 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:31.163631 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:31.164341 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:31.164815 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:31.165234 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:31.189735 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-c3e798d7-c205-4cc5-8bed-3ef8e8cea419 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085225 Aug 24 17:38:31.190300 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:38:31 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:38:32.009763 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: DEBUG nova.api.openstack.wsgi [None req-d97d0890-776d-407d-9321-002f475357df admin admin] Calling method '>' {{(pid=112226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:32.010771 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: INFO nova.api.openstack.requestlog [None req-d97d0890-776d-407d-9321-002f475357df admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 17:38:32.011171 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: [pid: 112226|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 17:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:32.200566 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG nova.api.openstack.wsgi [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Calling method '>' {{(pid=112225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:32.203015 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:38:32.203015 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: warnings.warn(msg) Aug 24 17:38:32.204096 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:32.204573 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:32.205008 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:32.205734 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:32.206168 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:32.206572 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: DEBUG oslo_concurrency.lockutils [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:32.227993 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: INFO nova.api.openstack.requestlog [None req-a289d9d4-6741-4350-abe6-c264ef994c49 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078407 Aug 24 17:38:32.229161 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: [pid: 112225|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 17:38:32 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:39:28.074104 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: Wed Aug 24 17:39:28 2022 - graceful shutdown triggered... Aug 24 17:39:28.074638 dv-cinder-835384-24-iscsi devstack@n-api.service[112225]: Gracefully killing worker 1 (pid: 112225)... Aug 24 17:39:28.075079 dv-cinder-835384-24-iscsi devstack@n-api.service[112226]: Gracefully killing worker 2 (pid: 112226)... Aug 24 17:39:28.076393 dv-cinder-835384-24-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 17:39:29.075245 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: worker 1 buried after 1 seconds Aug 24 17:39:29.075245 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: worker 2 buried after 1 seconds Aug 24 17:39:29.075245 dv-cinder-835384-24-iscsi devstack@n-api.service[112224]: goodbye to uWSGI. Aug 24 17:39:29.076847 dv-cinder-835384-24-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 17:39:29.077397 dv-cinder-835384-24-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 17:39:29.080220 dv-cinder-835384-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:39:29.093046 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:39:29 2022] *** Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: nodename: dv-cinder-835384-24-iscsi Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: machine: x86_64 Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: clock source: unix Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: pcre jit disabled Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: detected number of CPU cores: 4 Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: current working directory: / Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:39:29.095879 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: your processes number limit is 47680 Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: your memory page size is 4096 bytes Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: detected max file descriptor number: 2048 Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: lock engine: pthread robust mutexes Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: thunder lock: enabled Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:39:29.096868 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:39:29.137608 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: Python main interpreter initialized at 0x56272c0d19c0 Aug 24 17:39:29.137608 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: python threads support enabled Aug 24 17:39:29.137608 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: your server socket listen backlog is limited to 100 connections Aug 24 17:39:29.137608 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:39:29.138063 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:39:29.138063 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: *** Operational MODE: preforking *** Aug 24 17:39:29.138319 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:39:29.138319 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: spawned uWSGI master process (pid: 127227) Aug 24 17:39:29.138531 dv-cinder-835384-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:39:29.139058 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: spawned uWSGI worker 1 (pid: 127239, cores: 1) Aug 24 17:39:29.139554 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: spawned uWSGI worker 2 (pid: 127241, cores: 1) Aug 24 17:39:29.139844 dv-cinder-835384-24-iscsi devstack@n-api.service[127227]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:39:29.802641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:39:29.803143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:39:30.966565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:30.966565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: from cryptography.utils import int_from_bytes Aug 24 17:39:30.967179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:30.967179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: from cryptography.utils import int_from_bytes Aug 24 17:39:30.967344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:30.967344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: from cryptography.utils import int_from_bytes Aug 24 17:39:30.967756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:30.967756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: from cryptography.utils import int_from_bytes Aug 24 17:39:33.355645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:39:33.356250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:39:33.356535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:39:33.356849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:39:33.357111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:39:33.357510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.357842 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.358168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.358494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.359202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.359338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.359617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.359944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.360285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.361110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.361443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.361778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-24-iscsi {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.362112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.362427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.362744 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.363070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.363382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.363712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.364023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.364539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.366895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.367206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.367530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.367833 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.368253 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-24-iscsi {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.368592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.368911 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.369229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.369649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.369970 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.370282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.370608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.370966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.371276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.371602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.371929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.372241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:39:33.372743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.372824 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:39:33.372896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.372896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.373037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:39:33.373257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.373448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:39:33.373571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.373673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:39:33.373846 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.374990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375622 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.375919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.376069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.376874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.377909 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-24-iscsi {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.378975 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379279 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.379897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.380894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381657 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.381964 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.382112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.382275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.382433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.384870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385770 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.385928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-24-iscsi {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386374 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.386985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387443 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.387892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.388038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.388376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.388544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.388771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.388928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.389939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.390857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.391906 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.392062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.392062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.392344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.392496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.392706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.393304 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.393469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.393469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.393771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.394963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.395877 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396027 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.396996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.397900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.398948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399100 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399252 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399550 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399701 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.399988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400775 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.400929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401533 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401533 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.401890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.402787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.403508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.403508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.403803 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.403949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.404206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.404206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.404206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.404700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.404852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.405007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.405161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.405317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.405472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.405623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.405767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.405925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.406077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.406228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.406379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.406533 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.406679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.406835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.406988 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.407139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.407303 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.407461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.407605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.407762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.407915 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.407915 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.408201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.408352 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.408495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.408686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.408841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.408995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.409139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.409299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.409453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.409596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.409746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.409890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.410034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.410177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.410333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.411301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.412184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.412349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.412507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.412694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.412853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.413007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.413152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.413803 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.413957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.414109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.414386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.414547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.414692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.414890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.415043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.415198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.415367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.415522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.415666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.415809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.415960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.416104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.416257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.416402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.416594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.416757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.416910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.417068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.417213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.417367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.417519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.417670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.417670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.417950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.418095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.418246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.418390 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.418534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.418676 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.418832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.418976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.419133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.419300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.419452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.419608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.419753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.419904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.420055 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.420207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.420351 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.420501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.420681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.420836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.420988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.421147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.421299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.421450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:33.421595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.421747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.421903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.422048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.422436 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.422594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.422755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.422900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.423900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.424059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.424409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.424742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.424951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.424951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425248 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425543 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.425840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426123 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426123 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.426857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.427870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428325 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428790 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.428945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429255 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.429894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.430785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.431928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.432901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.433052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.433198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.433349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.433493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.433668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.434155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.434315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.434474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.434629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.434879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.435993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.436947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437192 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437824 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.437982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.438135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.438286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.438431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.438574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.439367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.439541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.439688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.439839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.439985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440435 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440632 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.440937 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.441857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.442925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443268 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.443900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.444411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.444593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.444756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.444918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.445963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.446917 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447075 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.447881 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448831 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.448983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449829 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.449984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.450888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451189 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451647 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.451933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452229 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.452898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.453946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.454098 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.454613 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.454799 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455053 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.455954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456781 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.456949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.457879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.458993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.459904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.460891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461517 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.461823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.462904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.463999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.464162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.464320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.464662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.464823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.464996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.465147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.465456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.465617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.465767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.465925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.466855 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.467953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468424 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468592 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.468913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469555 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.469861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.470990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.471923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472381 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472381 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.472863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473172 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.473950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.474110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.474261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.474425 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.474602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.474897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.475049 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.475207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.475423 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.475685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.475852 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476690 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.476994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.477936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478561 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.478861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479805 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.479973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480132 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.480938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.481884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482197 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.482978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.483919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.484069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.484218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.484382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.484541 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.484767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.485073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.485233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.485384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486677 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486829 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.486979 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.487941 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488596 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.488918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489670 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.489983 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490133 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490451 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490775 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.490927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.491227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.491398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.491559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.491710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.491710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492016 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492342 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492499 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.492878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.493870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494021 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494493 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.494807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495284 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.495906 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.496058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.496357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.496524 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.496700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.496852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497209 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497838 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.497935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.498931 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.499973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500175 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500776 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.500958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.501043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.501126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.501257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.501834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.501918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502000 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502547 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.502983 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.503934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504151 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504374 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504641 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504881 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.504958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505266 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505554 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505912 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.505981 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506426 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.506936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507752 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.507970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.508994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509208 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509276 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.509664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.510972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.511916 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.512144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.512228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.512476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.512615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.512813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.513119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.513434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.513530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.513980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514156 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.514863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.515900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.516970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.517156 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.517390 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.517588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.517772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.517863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.518093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.518200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.518428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.518528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.519827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.520784 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521493 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.521807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522442 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.522982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523601 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523690 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.523998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.524962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525298 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.525913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.526861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.527806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528467 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.528814 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529356 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529752 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.529971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530425 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.530998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.531942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.532165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.532256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533171 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.533813 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.534787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535628 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.535938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.536894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537002 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.537965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.538151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.538250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.538480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.538643 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.538795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.539165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.539636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.539976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.540169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.540413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.540517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.540763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.540856 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.541843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.542090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.542180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.542402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.542492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.542731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.543800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.543903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.543992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544076 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544254 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.544633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.545760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.545760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.545923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.545994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546076 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546251 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546828 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.546911 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.547858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.548667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.548832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.548976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.549926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550548 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.550985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551631 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.551959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.552959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.553924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.554861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.555999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.556949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557585 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.557997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.558940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.559155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.559392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.559497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.559689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.559791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.560843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.561995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.562929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563240 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.563908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.564876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.565355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.565505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.565704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.565872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.566036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.566368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.566692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.566950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.567941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568054 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568709 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.568925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.569030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.569242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.569338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.569572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.569701 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.570976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571842 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.571948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572610 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.572940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.573960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574423 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.574991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.575940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576032 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576216 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576677 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.576998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577294 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.577906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.578107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.578215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.578467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.578709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.578816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.579956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.580888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.581910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582018 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.582876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583025 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583839 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.583996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.584964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.585899 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586561 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.586959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.587882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.588863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.589024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.589175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.589391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.589623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.589806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.590946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.591125 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.591360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.591524 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.591684 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.591843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.592855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.593152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.593322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.593557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.593715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.593715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.594115 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.594281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.594432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.594585 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.594743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.595409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.595586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.595741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.595898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.596971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597770 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.597929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598567 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.598880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599190 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599342 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.599958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.600201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.600379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.600567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.600809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.600809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601524 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601683 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.601985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.602930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603245 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603405 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603803 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.603973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.604144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.604390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.604584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.604766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.604928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.605903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606054 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.606847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607629 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.607945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.608927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.609096 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.609258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.609418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.609619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.609795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.610027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.610214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.610448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.610669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.611407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.611648 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.611807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.611807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.612958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.613977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.614260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.614535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.614703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.614862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615181 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615649 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.615964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.616269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.616437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.616671 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.616846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617251 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617568 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.617886 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.618999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.619974 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.620214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.620370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.620681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.620859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.620859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621163 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.621995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.622298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.622459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.622618 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.622781 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.622942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623102 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623253 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.623862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.624099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.624257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.624409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.624589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.624876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.625984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.626169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.627422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.628603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.629625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.629625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.629625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.630096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.630341 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.630506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.630778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.631099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.631414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.631750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.632064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.632378 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.632715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.633032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.633598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.633918 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.634236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.634548 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.634929 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.635226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.635558 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.635887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.636202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.636533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.636886 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.637240 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.637609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.637891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.638224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.638540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.638857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.639165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:33.639432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:39:33.685150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO dbcounter [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Registered counter for database nova_api Aug 24 17:39:33.701621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO dbcounter [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Registered counter for database nova_api Aug 24 17:39:33.705740 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.713366 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writer thread running {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.722817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_db.sqlalchemy.engines [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.729741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writer thread running {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.772904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.context [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6f79d34-d459-413a-9a07-4219ab368fd7(cell1) {{(pid=127241) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:39:33.777134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:33.777619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:33.779188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:33.779923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:33.780381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:33.782431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:33.784459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO dbcounter [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Registered counter for database nova_cell0 Aug 24 17:39:33.788117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.context [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6f79d34-d459-413a-9a07-4219ab368fd7(cell1) {{(pid=127239) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:39:33.788536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO dbcounter [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Registered counter for database nova_cell1 Aug 24 17:39:33.792299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:33.792900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:33.794533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:33.795530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:33.796005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:33.798079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.798218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:33.799304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.800185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO dbcounter [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Registered counter for database nova_cell0 Aug 24 17:39:33.805123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO dbcounter [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Registered counter for database nova_cell1 Aug 24 17:39:33.807810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writer thread running {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.810120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writer thread running {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.811934 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_db.sqlalchemy.engines [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.814260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_db.sqlalchemy.engines [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.819810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writer thread running {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.822472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writer thread running {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.959319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO dbcounter [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Registered counter for database nova_cell0 Aug 24 17:39:33.966066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.970539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writer thread running {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:33.970667 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO dbcounter [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Registered counter for database nova_cell0 Aug 24 17:39:33.977105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_db.sqlalchemy.engines [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:33.981485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writer thread running {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:34.291664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: WARNING keystonemiddleware.auth_token [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:34.299550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: WARNING keystonemiddleware.auth_token [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:34.304449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: WARNING keystonemiddleware.auth_token [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:34.311764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: WARNING keystonemiddleware.auth_token [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:34.644505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: WARNING keystonemiddleware.auth_token [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:34.651122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: WARNING keystonemiddleware.auth_token [None req-d3c1be2b-71bd-4c5b-befa-ec1c026d64eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:34.655128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: WARNING keystonemiddleware.auth_token [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:34.656476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56272c0d19c0 pid: 127241 (default app) Aug 24 17:39:34.661752 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: WARNING keystonemiddleware.auth_token [None req-53b9a4b6-f5b7-44ca-b1e5-70426f680ddd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:34.667100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56272c0d19c0 pid: 127239 (default app) Aug 24 17:40:10.213311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.215614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.217662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.219525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.833581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.834726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.836603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:10.839309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:11.278402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fbe1ba31-a3e8-4fd6-b365-830996a98c05 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66ccb4430>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:11.326857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f162e7e1-aeed-4058-b3c8-26355f328a49 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Action: 'create', calling method: .version_select at 0x7fa66cce4940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1833973122"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:12.596217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fbe1ba31-a3e8-4fd6-b365-830996a98c05 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/91e29916-ac98-4272-a8b5-046caeab38ca" status: 200 len: 350 microversion: 2.1 time: 1.771934 Aug 24 17:40:12.597023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 1/1] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:10 2022] GET /compute/v2.1/os-volumes/91e29916-ac98-4272-a8b5-046caeab38ca => generated 350 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:13.188111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f162e7e1-aeed-4058-b3c8-26355f328a49 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.991830 Aug 24 17:40:13.188807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Aug 24 17:40:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2994 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:40:13.206519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-97d35b66-4eec-4df0-bafc-ea4eb9708f14 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb77700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:13.271482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-97d35b66-4eec-4df0-bafc-ea4eb9708f14 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 200 len: 345 microversion: 2.1 time: 0.070902 Aug 24 17:40:13.279204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:13 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:14.294235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-636462e0-5048-404f-ab67-c6baa5bccf25 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb3c790>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:14.446702 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-636462e0-5048-404f-ab67-c6baa5bccf25 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 200 len: 346 microversion: 2.1 time: 0.164134 Aug 24 17:40:14.460291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:14 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:14.461847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1422ecd8-4960-434e-be94-62e29cab2d38 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Action: 'create', calling method: .version_select at 0x7fa66cb77dc0>, body: {"snapshot": {"volume_id": "7530aefa-9b2a-432c-a271-385d17236cf7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-828457320"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:14.970698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1422ecd8-4960-434e-be94-62e29cab2d38 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.513066 Aug 24 17:40:14.978765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 3/5] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Aug 24 17:40:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:14.986406 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8ddbe0f8-33fd-4f6b-814c-ef572da65456 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb3ce50>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:15.152180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8ddbe0f8-33fd-4f6b-814c-ef572da65456 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.172477 Aug 24 17:40:15.154682 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:14 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:15.165882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c0ef2c9b-5cae-4251-921b-b8397bbc98c0 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb779d0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:15.257684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c0ef2c9b-5cae-4251-921b-b8397bbc98c0 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.095701 Aug 24 17:40:15.258722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 24 17:40:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:15.271293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ff101d96-f697-4705-8b05-c12bb62827df tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb505e0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:15.357826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ff101d96-f697-4705-8b05-c12bb62827df tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.091543 Aug 24 17:40:15.358764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:15 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:15.624284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3193deda-5be5-4ea3-8143-fb742a546047 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb4c700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:15.776991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3193deda-5be5-4ea3-8143-fb742a546047 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a1681dca-a5e7-4191-8b74-3a93a9caeaed" status: 200 len: 350 microversion: 2.1 time: 0.156013 Aug 24 17:40:15.781099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 5/9] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:15 2022] GET /compute/v2.1/os-volumes/a1681dca-a5e7-4191-8b74-3a93a9caeaed => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:16.370543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4388080f-2f13-4863-bbff-bd8f0cdf459c tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb3cc10>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:16.443515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4388080f-2f13-4863-bbff-bd8f0cdf459c tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.077486 Aug 24 17:40:16.444627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:16 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:17.456806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-60523edb-d33a-48b2-b16e-62781bc238a0 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb77670>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:17.541200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-60523edb-d33a-48b2-b16e-62781bc238a0 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.088259 Aug 24 17:40:17.541804 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:17 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:18.554940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-31ea3ba3-6932-4747-a207-b99ad22dd0a6 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb3c5e0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:18.634145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-31ea3ba3-6932-4747-a207-b99ad22dd0a6 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.084037 Aug 24 17:40:18.639187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:18 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:19.647872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b4002b15-adfa-49a2-b522-a28da3b03cec tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cce4a60>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:19.712348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b4002b15-adfa-49a2-b522-a28da3b03cec tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.068578 Aug 24 17:40:19.717422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:19 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:20.726438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9560de3d-6211-47da-bf98-89cf3374f60a tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb50310>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:20.823530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9560de3d-6211-47da-bf98-89cf3374f60a tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.101505 Aug 24 17:40:20.824442 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 7/14] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:20 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:21.836201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-55de3225-91bf-43f9-9449-ef71457e8927 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb4c9d0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:21.905490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-55de3225-91bf-43f9-9449-ef71457e8927 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 287 microversion: 2.1 time: 0.072993 Aug 24 17:40:21.907391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:21 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:40:21.921841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-df1991ca-d94e-4ef9-8d5d-fe43b6103bd2 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb50c10>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.082058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-df1991ca-d94e-4ef9-8d5d-fe43b6103bd2 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 202 len: 0 microversion: 2.1 time: 0.165762 Aug 24 17:40:22.083338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 24 17:40:21 2022] DELETE /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:40:22.091461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-85047a96-fa85-489c-9993-fe777f50276f tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb4c1f0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.183121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-85047a96-fa85-489c-9993-fe777f50276f tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 200 len: 286 microversion: 2.1 time: 0.095796 Aug 24 17:40:22.183909 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 9/17] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:22.205929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-61a2e8ce-6379-4ee2-9d8b-cb81e9b35376 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb50ca0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.312933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-61a2e8ce-6379-4ee2-9d8b-cb81e9b35376 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c234aa2f-960d-408b-a38f-86ac1416af0e" status: 200 len: 351 microversion: 2.1 time: 0.110863 Aug 24 17:40:22.323017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 9/18] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes/c234aa2f-960d-408b-a38f-86ac1416af0e => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:22.327597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c9e3fcd1-7ad7-4dc6-8666-b1536cefef3d tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb37a60>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.505938 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c9e3fcd1-7ad7-4dc6-8666-b1536cefef3d tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.182879 Aug 24 17:40:22.506990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 10/19] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:22.520697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e98ec699-d995-4ab9-b34c-6cb1699ef38c tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb504c0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.666530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e98ec699-d995-4ab9-b34c-6cb1699ef38c tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.149496 Aug 24 17:40:22.669728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 10/20] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:22.684849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9f6bdeab-56a4-44f9-b674-0f64e7ee5780 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb77940>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.807651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9f6bdeab-56a4-44f9-b674-0f64e7ee5780 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.129054 Aug 24 17:40:22.808382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:22.821888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-21870716-8964-45be-8c75-e286dc62752c tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb4ca60>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.922967 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-940286873", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:23.133830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-21870716-8964-45be-8c75-e286dc62752c tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.315907 Aug 24 17:40:23.134416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 12/22] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:23.149490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] validate_networks() for [('d55932dd-2dc8-4d13-9500-87780006215c', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:23.158467 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-665a1d6c-f394-4f3a-87a3-2062a024b1c7 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb4cca0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.409167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-665a1d6c-f394-4f3a-87a3-2062a024b1c7 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255406 Aug 24 17:40:23.419829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 13/23] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:23.425433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2da7b20d-df61-495c-b5da-866216def15d tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb37820>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.470801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-2da7b20d-df61-495c-b5da-866216def15d tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] HTTP exception thrown: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2da7b20d-df61-495c-b5da-866216def15d tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Request method failure captured: Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 HTTP/1.1 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmJ6x-fXJmvjU8nWhKm4DAO6nLkYAJs6HqqNS5-vsVpcoRHtjMTJohR4iBKDF7Ss4n4BlGuO51u8C7n8UcrKW6IXcvJ_KbBtghEX4fmSzNBZb1Ca_U02nMSmEtSWSvqKP8nMTWlgd3ShLhSprY24wfxVX_jccGFwLqlA_6pUsZk2eH8 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:40:23.474537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 2d27ff5caebd413caf117b61e1f74c8a Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'f5d0588d-2e89-4245-bafe-4253dc2db237'} Aug 24 17:40:23.475786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. (HTTP 404) (Request-ID: req-226eca81-b200-4cc6-864f-3ac518959f17) Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.476590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:23.477626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 17:40:23.478519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2da7b20d-df61-495c-b5da-866216def15d tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Returning 404 to user: Snapshot f5d0588d-2e89-4245-bafe-4253dc2db237 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2da7b20d-df61-495c-b5da-866216def15d tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237" status: 404 len: 111 microversion: 2.1 time: 0.055075 Aug 24 17:40:23.480427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 14/24] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-snapshots/f5d0588d-2e89-4245-bafe-4253dc2db237 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:23.484506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-aa36d8f8-932f-457a-9f3b-efb3afc674d3 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb370d0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.644940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-aa36d8f8-932f-457a-9f3b-efb3afc674d3 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164021 Aug 24 17:40:23.645672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 15/25] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:23.650343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b4648e8f-7306-47d8-b3b0-0f612a0872d2 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb38dc0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.800588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b4648e8f-7306-47d8-b3b0-0f612a0872d2 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 202 len: 0 microversion: 2.1 time: 0.147133 Aug 24 17:40:23.801271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 16/26] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:40:23 2022] DELETE /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:40:23.807023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7bdd48bd-9dac-4242-bfc3-e8c730ccacb0 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cb388b0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.918254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7bdd48bd-9dac-4242-bfc3-e8c730ccacb0 tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.115837 Aug 24 17:40:23.919296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 17/27] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:23.925457 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8e5f80a4-c144-4ad6-a06b-e8cf29bb647f tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cb37280>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.996404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8e5f80a4-c144-4ad6-a06b-e8cf29bb647f tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 200 len: 345 microversion: 2.1 time: 0.075846 Aug 24 17:40:23.997188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 18/28] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:24.002344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f22be15c-3156-41ba-a0a1-725df1adde9b tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] Calling method '.version_select at 0x7fa66cab14c0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:24.161255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f22be15c-3156-41ba-a0a1-725df1adde9b tempest-VolumesTestJSON-795260889 tempest-VolumesTestJSON-795260889-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.162586 Aug 24 17:40:24.162844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 19/29] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:24.599076 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:24.600021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:24.600524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:24.602249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:24.602684 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:24.631425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:24.632753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:24.632753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:24.633085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:24.638108 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:24.640888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:24.707084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:24.716946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for user 40c0367417434c04948e9f2a03e880a9 and project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:24.739494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:24.747874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:24.935382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-53526320-8c35-457a-bf22-2b5c667dffed tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.215324 Aug 24 17:40:24.938704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 11/30] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:40:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:40:24.953976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e268622e-1424-424d-85b6-1f41795777ba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:24.960199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e268622e-1424-424d-85b6-1f41795777ba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:25.028276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-073ba652-2ac2-4db0-aaa6-ca8b4c3284be tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66ca5ee50>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:25.204334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-073ba652-2ac2-4db0-aaa6-ca8b4c3284be tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 200 len: 345 microversion: 2.1 time: 0.190405 Aug 24 17:40:25.211566 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 12/31] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:25 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:40:25.289619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e268622e-1424-424d-85b6-1f41795777ba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:25.329779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e268622e-1424-424d-85b6-1f41795777ba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1221 microversion: 2.1 time: 0.375105 Aug 24 17:40:25.331681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 20/32] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:24 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1221 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:25.503890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-876405492", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:25.612211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] validate_networks() for [('d55932dd-2dc8-4d13-9500-87780006215c', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:26.220766 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d388d350-6f31-4a58-bcf5-1fe697531469 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66cab1430>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.308333 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d388d350-6f31-4a58-bcf5-1fe697531469 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 200 len: 345 microversion: 2.1 time: 0.093106 Aug 24 17:40:26.315794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 21/33] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:40:26.427295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:26.427965 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:26.429651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:26.430679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:26.431354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:26.454486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:26.455271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:26.455848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:26.456925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:26.457797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:26.458937 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:26.514323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:26.519957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for user 40c0367417434c04948e9f2a03e880a9 and project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:26.553977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:26.556692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:26.668273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4f60378f-0364-4687-9326-11abcab710cd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.168594 Aug 24 17:40:26.670102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 13/34] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:40:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:40:26.681349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-33e3448a-ef11-4ff6-b55e-bd0f3e5b5d1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.682137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-33e3448a-ef11-4ff6-b55e-bd0f3e5b5d1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:26.808096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-33e3448a-ef11-4ff6-b55e-bd0f3e5b5d1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:26.820037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-33e3448a-ef11-4ff6-b55e-bd0f3e5b5d1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1221 microversion: 2.1 time: 0.142248 Aug 24 17:40:26.821244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 22/35] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:27.147921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6b186515-0845-45c7-905c-769976f14ee3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: .version_select at 0x7fa66ca5ea60>, body: {"keypair": {"name": "tempest-keypair-1412886604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJI5m5xBD3AycJB8h8Atw3498ZSKV/3AM5Xz1RDTUTon+fMoDy7txBXX1Rl8ta4qA5MHRmk6i364HqOqtmZrN1U3qEOoi7E8rh0sl0SWSgu0xNLAUJ1D1AiN+YK1GSqmQ=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:27.245249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-6b186515-0845-45c7-905c-769976f14ee3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:27.248032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1821273971", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "networks": [{"uuid": "f3064703-fe0e-464f-a99c-7691dc067d25"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:27.252314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-6b186515-0845-45c7-905c-769976f14ee3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:27.430473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6b186515-0845-45c7-905c-769976f14ee3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401907 Aug 24 17:40:27.434189 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 14/36] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:40:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:27.457363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-62dbe584-272d-4538-a6a8-ded359296386 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66c1f8e50>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.562250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-62dbe584-272d-4538-a6a8-ded359296386 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] HTTP exception thrown: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-62dbe584-272d-4538-a6a8-ded359296386 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Request method failure captured: Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 HTTP/1.1 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmJ6x-fXJmvjU8nWhKm4DAO6nLkYAJs6HqqNS5-vsVpcoRHtjMTJohR4iBKDF7Ss4n4BlGuO51u8C7n8UcrKW6IXcvJ_KbBtghEX4fmSzNBZb1Ca_U02nMSmEtSWSvqKP8nMTWlgd3ShLhSprY24wfxVX_jccGFwLqlA_6pUsZk2eH8 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:40:27.571592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 2d27ff5caebd413caf117b61e1f74c8a Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '7530aefa-9b2a-432c-a271-385d17236cf7'} Aug 24 17:40:27.572731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. (HTTP 404) (Request-ID: req-5da0e571-ce78-42e0-87df-48a805cc4418) Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.573433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:27.574555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:40:27.575583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-62dbe584-272d-4538-a6a8-ded359296386 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Returning 404 to user: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:27.576598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-62dbe584-272d-4538-a6a8-ded359296386 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 404 len: 109 microversion: 2.1 time: 0.138435 Aug 24 17:40:27.579778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 15/37] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:27.593809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1f390f7f-c54b-49f6-8b3d-b4ed806e98b4 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66c1daca0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.619527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] validate_networks() for [('f3064703-fe0e-464f-a99c-7691dc067d25', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:27.700218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-1f390f7f-c54b-49f6-8b3d-b4ed806e98b4 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] HTTP exception thrown: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1f390f7f-c54b-49f6-8b3d-b4ed806e98b4 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Request method failure captured: Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 HTTP/1.1 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmJ6x-fXJmvjU8nWhKm4DAO6nLkYAJs6HqqNS5-vsVpcoRHtjMTJohR4iBKDF7Ss4n4BlGuO51u8C7n8UcrKW6IXcvJ_KbBtghEX4fmSzNBZb1Ca_U02nMSmEtSWSvqKP8nMTWlgd3ShLhSprY24wfxVX_jccGFwLqlA_6pUsZk2eH8 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:40:27.703583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 2d27ff5caebd413caf117b61e1f74c8a Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '7530aefa-9b2a-432c-a271-385d17236cf7'} Aug 24 17:40:27.706015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. (HTTP 404) (Request-ID: req-13d0974e-4fda-41cb-839c-60ceb821031f) Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.706767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:27.707795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:40:27.708878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.709942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.712220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1f390f7f-c54b-49f6-8b3d-b4ed806e98b4 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Returning 404 to user: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:27.715125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1f390f7f-c54b-49f6-8b3d-b4ed806e98b4 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 404 len: 109 microversion: 2.1 time: 0.129801 Aug 24 17:40:27.716907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 16/38] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:40:27 2022] DELETE /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:40:27.726893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-30bbe63d-8cc4-4148-923f-2f5adafc84d5 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Calling method '.version_select at 0x7fa66c1daaf0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.848756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-30bbe63d-8cc4-4148-923f-2f5adafc84d5 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] HTTP exception thrown: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-30bbe63d-8cc4-4148-923f-2f5adafc84d5 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Request method failure captured: Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 HTTP/1.1 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmJ6x-fXJmvjU8nWhKm4DAO6nLkYAJs6HqqNS5-vsVpcoRHtjMTJohR4iBKDF7Ss4n4BlGuO51u8C7n8UcrKW6IXcvJ_KbBtghEX4fmSzNBZb1Ca_U02nMSmEtSWSvqKP8nMTWlgd3ShLhSprY24wfxVX_jccGFwLqlA_6pUsZk2eH8 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:40:27.852094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3cbb522709a64ec1abdf99ede28bcae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 3cbb522709a64ec1abdf99ede28bcae6 Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-201116454 Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 2d27ff5caebd413caf117b61e1f74c8a Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-201116454-project Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '7530aefa-9b2a-432c-a271-385d17236cf7'} Aug 24 17:40:27.853345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. (HTTP 404) (Request-ID: req-e9bbe92b-8a23-4010-9ab9-c240aecc7d9a) Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.854087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:27.854997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:40:27.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. Aug 24 17:40:27.857262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:27.859384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-30bbe63d-8cc4-4148-923f-2f5adafc84d5 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] Returning 404 to user: Volume 7530aefa-9b2a-432c-a271-385d17236cf7 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:27.862240 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-30bbe63d-8cc4-4148-923f-2f5adafc84d5 tempest-VolumesSnapshotsTestJSON-201116454 tempest-VolumesSnapshotsTestJSON-201116454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7" status: 404 len: 109 microversion: 2.1 time: 0.139799 Aug 24 17:40:27.863269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 17/39] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/os-volumes/7530aefa-9b2a-432c-a271-385d17236cf7 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:27.881945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00b0b509-330c-4150-8e1e-3910a29c868a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.886360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-00b0b509-330c-4150-8e1e-3910a29c868a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:28.497756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-00b0b509-330c-4150-8e1e-3910a29c868a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:28.538524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-00b0b509-330c-4150-8e1e-3910a29c868a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1221 microversion: 2.1 time: 0.671041 Aug 24 17:40:28.542247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 18/40] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1221 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:29.172543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0adc51b3-c4b1-4bcb-97cd-32dc66b0a5e0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: .version_select at 0x7fa66c17edc0>, body: {"keypair": {"name": "tempest-keypair-1264336043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWiYMRmYQ1cSv0h5nOVghKBBroNRlRziRkRVjSTjuEHb9dLTA/rPcvsJ6LjO6IBmUzVQp0/hZ5VFsiIzih9R0EfxwvdqdvG1q6UBR7x2n/9PcxqzD87Iy/Sv8rAuVZEbA=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:29.249297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-0adc51b3-c4b1-4bcb-97cd-32dc66b0a5e0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for project 761d3524ec174bcb8f207cff3728bcea. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:29.261713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-0adc51b3-c4b1-4bcb-97cd-32dc66b0a5e0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for user 892dad01ea684e6cb2d5cec659c6c4b9 and project 761d3524ec174bcb8f207cff3728bcea. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:29.326396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0adc51b3-c4b1-4bcb-97cd-32dc66b0a5e0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.782748 Aug 24 17:40:29.335776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 19/41] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 24 17:40:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 793 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:40:29.563279 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:29.564074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:29.587998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:29.591283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:29.592141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:29.596273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:29.599748 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:29.601025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:30.131664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:30.145946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-21e003c5-f0b0-406b-8644-d0a0c6a62534 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1273 microversion: 2.1 time: 0.588095 Aug 24 17:40:30.146538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 20/42] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:29 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1273 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:30.201375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:30.201888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:30.202939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:30.204201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:30.213114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:30.247947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:30.258600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:30.261468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:30.267692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:30.270397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:30.271105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:30.350520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Getting quotas for project 9206de8ce97b425cb5c675ec0a240d71. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:30.362624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Getting quotas for user 1d0ae308269b4cdd80990f7b38c0cd0c and project 9206de8ce97b425cb5c675ec0a240d71. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:30.378594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:30.382256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:30.529733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6ea236a4-1ff0-4248-b34f-3db6287298e7 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.469818 Aug 24 17:40:30.543437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 23/43] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:40:30.546984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2afd6304-19dd-48fe-9177-27e695b23736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:30.547611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2afd6304-19dd-48fe-9177-27e695b23736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:30.921779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2afd6304-19dd-48fe-9177-27e695b23736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:30.930466 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2afd6304-19dd-48fe-9177-27e695b23736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1215 microversion: 2.1 time: 0.387601 Aug 24 17:40:30.936522 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:30 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:31.171708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:31.173663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:31.199183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:31.202402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:31.204200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:31.210039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:31.211847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:31.213062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:31.555887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:31.577789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-348eeac3-ba78-4663-9d21-56cd0e9c5f11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1273 microversion: 2.1 time: 0.411039 Aug 24 17:40:31.581599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 24/45] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:31 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:31.960702 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:31.961327 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:31.973201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:31.973697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:31.974319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:31.977775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:31.978532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:31.981149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:32.142047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:32.162684 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-70745436-b8d6-4744-848d-2ac043415756 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1219 microversion: 2.1 time: 0.205911 Aug 24 17:40:32.164333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 22/46] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:31 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1219 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:32.273296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6da2a7db-4640-4a02-a66c-6a5573152e04 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Action: 'create', calling method: .version_select at 0x7fa66c10da60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2003705648", "metadata": {"Type": "work"}}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6da2a7db-4640-4a02-a66c-6a5573152e04 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 122 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:40:32.279753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2003705648", "metadata": {"Type": "work"}}} Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:40:32.280889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2003705648', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.281538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:32.282571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:32.284208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:32.284208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.290158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6da2a7db-4640-4a02-a66c-6a5573152e04 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.294087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6da2a7db-4640-4a02-a66c-6a5573152e04 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.214736 Aug 24 17:40:32.295302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 25/47] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:32.304994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9cb5b0a4-c048-481c-8f29-0a036887b128 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Action: 'create', calling method: .version_select at 0x7fa66c0c0160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-823654849", "metadata": {"Type": "work"}}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9cb5b0a4-c048-481c-8f29-0a036887b128 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 119 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:40:32.310182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-823654849", "metadata": {"Type": "work"}}} Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: Aug 24 17:40:32.311679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-823654849', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi '0' Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.312472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:32.313639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:32.314764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:32.314764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.318826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9cb5b0a4-c048-481c-8f29-0a036887b128 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.319805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9cb5b0a4-c048-481c-8f29-0a036887b128 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018912 Aug 24 17:40:32.325708 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 23/48] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:32.331293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-87d84050-a995-4ff4-8519-04778b21e44b tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Action: 'create', calling method: .version_select at 0x7fa66c0b9820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1186216374", "metadata": {"Type": "work"}}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-87d84050-a995-4ff4-8519-04778b21e44b tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 119 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:40:32.337220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1186216374", "metadata": {"Type": "work"}}} Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:40:32.338389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1186216374', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi '' Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.339019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:32.340064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:32.341815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:32.341815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.341815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-87d84050-a995-4ff4-8519-04778b21e44b tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.342812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-87d84050-a995-4ff4-8519-04778b21e44b tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015623 Aug 24 17:40:32.348892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 26/49] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:32.354584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-798460b7-e02f-4c90-b3b1-ba467e905377 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Calling method '.version_select at 0x7fa66c0dff70>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:32.405415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-798460b7-e02f-4c90-b3b1-ba467e905377 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] HTTP exception thrown: Volume tempest-invalid-1629586375 could not be found. Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-798460b7-e02f-4c90-b3b1-ba467e905377 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1629586375 HTTP/1.1 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:40:32.407405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Volume tempest-invalid-1629586375 could not be found. Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'tempest-invalid-1629586375'} Aug 24 17:40:32.409588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1629586375 could not be found. (HTTP 404) (Request-ID: req-89b46256-57b8-47ae-85e7-ffc809cdd2de) Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.410223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:32.411188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1629586375 could not be found. Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:32.412073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1629586375 could not be found. Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1629586375 could not be found. Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-798460b7-e02f-4c90-b3b1-ba467e905377 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 404 to user: Volume tempest-invalid-1629586375 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-798460b7-e02f-4c90-b3b1-ba467e905377 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1629586375" status: 404 len: 99 microversion: 2.1 time: 0.059451 Aug 24 17:40:32.416444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 24/50] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 17:40:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1629586375 => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:40:32.422185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dde2494f-d051-440a-bf15-ee8834448fa3 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006490 Aug 24 17:40:32.422731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 27/51] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 24 17:40:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:40:32.432741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2d5d9b22-1de2-4f42-b330-3fe60fd72b9a tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004238 Aug 24 17:40:32.436708 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 25/52] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Aug 24 17:40:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:40:32.442771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1ed254bf-f9ae-4fe6-b8c3-3fddf87a2f81 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Calling method '.version_select at 0x7fa66c11d8b0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:32.461712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-416245647", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1229ac7-2636-42fd-bd13-5a97e33445e1"}], "security_groups": [{"name": "tempest-securitygroup--214064603"}], "key_name": "tempest-keypair-1412886604", "user_data": "}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:32.508528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-1ed254bf-f9ae-4fe6-b8c3-3fddf87a2f81 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] HTTP exception thrown: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1ed254bf-f9ae-4fe6-b8c3-3fddf87a2f81 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: DELETE /compute/v2.1/os-volumes/8836464a-d950-43d6-ba1f-083d414228c4 HTTP/1.1 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:40:32.512828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '8836464a-d950-43d6-ba1f-083d414228c4'} Aug 24 17:40:32.513981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. (HTTP 404) (Request-ID: req-07db1d31-fb5a-4599-9008-24bd1334846f) Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.514708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:32.515696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:40:32.516933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. Aug 24 17:40:32.518611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.519940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1ed254bf-f9ae-4fe6-b8c3-3fddf87a2f81 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 404 to user: Volume 8836464a-d950-43d6-ba1f-083d414228c4 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.523714 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1ed254bf-f9ae-4fe6-b8c3-3fddf87a2f81 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8836464a-d950-43d6-ba1f-083d414228c4" status: 404 len: 109 microversion: 2.1 time: 0.082413 Aug 24 17:40:32.524596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 28/53] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:40:32 2022] DELETE /compute/v2.1/os-volumes/8836464a-d950-43d6-ba1f-083d414228c4 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:32.537778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dda7e342-657e-4b95-acb7-895655ba0b76 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Calling method '.version_select at 0x7fa66cb77b80>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:32.577555 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-dda7e342-657e-4b95-acb7-895655ba0b76 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] HTTP exception thrown: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dda7e342-657e-4b95-acb7-895655ba0b76 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Request method failure captured: Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/os-volumes/b8784b22-3c56-4b52-9459-51221d860708 HTTP/1.1 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKPkchTOJy-QOPyIzbzg76fFdFFoGM_dYbW7rhbjJ8uL6RCecIQUtbbn06UCUHHPH3qtyJYspoKbIxTEGwGVP1ZwFN2SVDRikfdzNuVLgo3q2tC0TSpY0M6WJ0WvknK22YmWmJLpVfjl2yWXYWGrkKt19r-VjK4zrfK5f-feDJu-JY Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:40:32.580331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1316765024f429bae881e682da29c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1316765024f429bae881e682da29c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1316765024f429bae881e682da29c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: a1316765024f429bae881e682da29c80 Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesNegativeTest-1251792502 Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 0b053021680047488ee4e3bc75681cc7 Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesNegativeTest-1251792502-project Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'b8784b22-3c56-4b52-9459-51221d860708'} Aug 24 17:40:32.581549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. (HTTP 404) (Request-ID: req-7acd09b6-afe5-47ed-867d-66843ea428b1) Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.582187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:32.583085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:40:32.584028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. Aug 24 17:40:32.584960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:40:32.587440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dda7e342-657e-4b95-acb7-895655ba0b76 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] Returning 404 to user: Volume b8784b22-3c56-4b52-9459-51221d860708 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:32.588516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dda7e342-657e-4b95-acb7-895655ba0b76 tempest-VolumesNegativeTest-1251792502 tempest-VolumesNegativeTest-1251792502-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/b8784b22-3c56-4b52-9459-51221d860708" status: 404 len: 109 microversion: 2.1 time: 0.059160 Aug 24 17:40:32.590569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 29/54] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:32 2022] GET /compute/v2.1/os-volumes/b8784b22-3c56-4b52-9459-51221d860708 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:32.606976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:32.607636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:32.630604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:32.631097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:32.634823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:32.638687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:32.639478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:32.640063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:32.816980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] validate_networks() for [('b1229ac7-2636-42fd-bd13-5a97e33445e1', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:33.036758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:33.045757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2c9cd74a-905e-4e5a-af8a-900e599a72f0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1273 microversion: 2.1 time: 0.448310 Aug 24 17:40:33.056975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 30/55] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:32 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:33.186561 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:33.187317 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:33.199714 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:33.200389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:33.203572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:33.205896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:33.207744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:33.210858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:33.682927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:33.697319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5fec225e-adf1-4148-878b-b59ac21494c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1211 microversion: 2.1 time: 0.513179 Aug 24 17:40:33.700450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 31/56] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:33 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1211 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:34.077322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:34.079339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:34.097636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:34.098408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:34.099037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:34.100135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:34.100836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:34.101654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:34.779475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:34.799697 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7f957403-5a58-4d3c-a1a9-6e4373bbd3f9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1279 microversion: 2.1 time: 0.728615 Aug 24 17:40:34.824610 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 32/57] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:34 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1279 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:34.851646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1042916979", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c112f9b2-f4e4-4b01-8e76-6fe4d4495e59"}], "security_groups": [{"name": "tempest-securitygroup--429819819"}], "key_name": "tempest-keypair-1264336043", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:36.319155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] validate_networks() for [('c112f9b2-f4e4-4b01-8e76-6fe4d4495e59', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:36.476968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:36.942526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:36.946220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:36.947060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:36.947743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:36.948601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:36.992517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:36.996985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:36.998822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:36.999695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:37.000172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:37.013369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:37.074304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:37.079413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:37.116132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:37.118911 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:37.287105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-86469397-8af4-41cf-98e3-ca0be90fd1be tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.834075 Aug 24 17:40:37.295311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 26/58] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:40:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 4844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:40:37.304439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:37.322677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:37.358525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:37.362775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:37.364873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:37.365810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:37.369783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:37.370979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:37.524262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:37.533995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f713babb-b388-4785-8133-447f64fc6e0e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1273 microversion: 2.1 time: 0.237416 Aug 24 17:40:37.534586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 27/59] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:37 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:37.573897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:37.574768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:37.605705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:37.606788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:37.607978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:37.610472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:37.613055 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:37.613727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.484709 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:38.502722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e9334204-ea00-4a9a-a11a-d8ff3857a4c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.952096 Aug 24 17:40:38.503506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 28/60] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:37 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:38.508202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:38.508868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:38.516575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.517935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.518700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.519658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.520448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.521129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.570955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:38.571695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:38.571851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:38.572673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:38.573281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:38.595968 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.596728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.597318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.598236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.598866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.599456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.638828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for project 761d3524ec174bcb8f207cff3728bcea. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:38.646595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for user 892dad01ea684e6cb2d5cec659c6c4b9 and project 761d3524ec174bcb8f207cff3728bcea. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:38.670831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:38.677507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:38.692702 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:38.717949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b62f3fdb-9944-451d-98ad-84a9ffbd4897 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.211439 Aug 24 17:40:38.719749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 29/61] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:38 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:38.733647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:38.734245 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:38.754075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.754578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.755017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.755746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:38.756212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:38.756679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:38.805310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-14389917-67bf-4af9-a3a2-8e269fad94a3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.977242 Aug 24 17:40:38.806720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 33/62] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 24 17:40:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 3982 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:40:38.823255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:38.824262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:38.966975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:38.976888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:38.978405 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:38.982557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7278016e-e492-488f-8d84-b33e2d15501d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1282 microversion: 2.20 time: 0.166765 Aug 24 17:40:38.983411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 34/63] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:38 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:39.044610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:39.061609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f1f5f484-6145-4c37-8c5d-995e5cf10c2d tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.339501 Aug 24 17:40:39.062187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 30/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:38 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:39.161121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d6009a-fc4f-49b2-af48-abd6d89ab491", "tag": "8ccacc97-2951-4972-9663-04a38f8d6f29"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:39.191904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.193647 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.194195 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.218892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Creating event network-changed:8ccacc97-2951-4972-9663-04a38f8d6f29 for instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 on hv-cinder-83538 Aug 24 17:40:39.219927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:40:39.220710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e5eaf3f2-94b4-4d8a-9f8e-41d955d185bf req-87ab5180-8316-43a1-8adc-288b1201915c service nova] Acquired lock "compute-rpcapi-router" {{(pid=127239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:40:39.222497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.223556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.224633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.225908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.228402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.229643 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.241280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.compute.rpcapi [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:40:39.243460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] Releasing lock "compute-rpcapi-router" {{(pid=127239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:40:39.273777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1dc55472-8944-460a-8276-f0fecf68772c None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237423 Aug 24 17:40:39.275208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 35/65] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:39.527557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:39.528308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:39.535790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.536414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.537356 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.538496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.538915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.539333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.685305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:39.698274 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3f2c8711-85ae-4d9b-8523-5f6f568decde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.173971 Aug 24 17:40:39.699506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 31/66] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:39 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:39.745171 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:39.745894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:39.754193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.754693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.755232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.756071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:39.756764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:39.757379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:39.838004 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:39.846841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a97ff7fc-c934-4822-9e10-bdb6b81bb643 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.107544 Aug 24 17:40:39.848101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 36/67] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:39 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:40.008212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:40.008778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:40.014835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.015430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.015862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.016536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.017239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.017662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.079359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:40.082777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:40.083680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:40.088227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:40.089814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:40.091041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.091203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-99c9a30e-f47f-46b6-b11b-1c178759c7ea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.086890 Aug 24 17:40:40.091864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.092879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.093928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.094746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.095572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.105411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 32/68] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:40 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:40.242715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:40.260063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-613eb483-a14b-491d-a98c-51c5e9633ded tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.181198 Aug 24 17:40:40.260604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 37/69] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:40 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:40.719555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:40.720170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:40.723100 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:40.727183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.727666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.728104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.728827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.729302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.729778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.869570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:40.870258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:40.876471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.877653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.878157 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.879051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:40.879756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:40.880249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:40.945220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:40.952982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9053b7ab-fc47-4482-b615-2ab40887308c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.237162 Aug 24 17:40:40.953559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 33/70] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:40 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:41.000383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:41.022027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bee7e0de-7e66-404e-bb3e-b83b1e20907d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.156208 Aug 24 17:40:41.022680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 38/71] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:40 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:41.115247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:41.115930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:41.125796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.129158 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.129751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:41.130606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.131324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.131903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:41.261758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:41.270164 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:41.271892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:41.273019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5c47568f-d22b-42ec-8c90-1aab6e1d99e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.163470 Aug 24 17:40:41.273918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 34/72] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:41 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:41.283336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:41.284533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:41.291143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.291602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.292197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:41.293075 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.293673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.294611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:41.568704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:41.588161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-85188cea-a252-4727-a129-66b9f5341ffc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.310593 Aug 24 17:40:41.590831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 39/73] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:41 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:41.976350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:41.976994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:41.984868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.986643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.987099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:41.988968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:41.989512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:41.989951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.043660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:42.044425 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:42.053691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.054823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.055404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.056487 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.056973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.057540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.196577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.198534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.207218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dbd797c8-e57d-412c-89bd-4478d6ca8e4f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.234931 Aug 24 17:40:42.207549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c945d3e6-a5ba-4b09-9235-5b0ab4ffe4e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.168056 Aug 24 17:40:42.208141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 40/74] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:42 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:42.208764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 35/75] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:41 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:42.298087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:42.300495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:42.309253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.309816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.310174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.312899 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.313376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.316911 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.426394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.435423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.437549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.438972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-70fa1e4a-490f-40a9-ae0b-22a2c8182c63 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.147527 Aug 24 17:40:42.452682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 41/76] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:42 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:42.623023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:42.623838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:42.630909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.632050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.632485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.633446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.633908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.634360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.846962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.857982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b0c0cd04-b948-4d1b-9ba6-4939247e935e tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.239128 Aug 24 17:40:42.859106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 36/77] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:42 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:43.231090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:43.231723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:43.240373 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.242464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:43.243988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:43.244312 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.245056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.248891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.251112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.251639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.251786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.252851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.254557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.257160 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.259705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.260639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.470440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.492259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-53f014aa-d449-4f15-9904-eeaa49c27a17 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.265659 Aug 24 17:40:43.492877 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 42/78] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:43 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:43.511512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:43.512131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:43.522983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.528404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.529424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.531723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.532738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.534054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.682744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.706618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.708262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.709638 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-790ecd71-7047-4ef4-8460-075437cc89f1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.215425 Aug 24 17:40:43.710244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 43/79] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:43 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:43.828257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.838021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b291a050-c8ad-4900-baf5-d2181c3de8c3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.599397 Aug 24 17:40:43.852728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 37/80] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:43 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:43.883612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:43.884273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:43.907437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.911165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.912577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:43.941005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:43.944711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:43.945242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.227068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:44.240021 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a052bd98-601b-4a4f-af6f-37b3e26aed01 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.362986 Aug 24 17:40:44.242511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 44/81] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:43 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:44.516183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:44.517264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:44.531948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.532508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.533017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.533722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.534177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.534689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.634051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:44.642389 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-047f8cd3-0b05-4183-baac-d9e5c16f4810 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.131785 Aug 24 17:40:44.655439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 38/82] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:44 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:44.731418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:44.732514 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:44.740045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.740853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.741822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.743140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.743922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.744681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.859304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:44.859915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:44.872081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.872592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.873027 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.878043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.880095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.884341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.917835 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:44.958446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:44.962106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:44.963436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6269fb65-a02e-4e7a-a318-ee070d3d9705 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.236065 Aug 24 17:40:44.964075 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 45/83] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:44 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:45.118557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:45.129481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fc1fe389-ff9d-4995-a6e8-8e405f7c5cbc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.273760 Aug 24 17:40:45.130446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 39/84] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:44 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:45.275789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:45.276532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:45.294711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:45.295892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:45.296711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:45.297634 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:45.299136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:45.302274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:45.556492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:45.570448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c401ce5f-2dfa-4bce-8b7e-f6cb6da60736 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.311271 Aug 24 17:40:45.571209 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 46/85] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:45 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:45.663424 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:45.664069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:45.670523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:45.671077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:45.671437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:45.672132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:45.672775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:45.673196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:45.691506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:45.773026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:45.786879 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-94b7d0a6-4ba4-4184-8fe2-170f570a4e69 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.127224 Aug 24 17:40:45.788014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 40/86] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:45 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:45.992696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:45.993364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:46.000849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.001737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.002313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.003124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.003746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.004447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.022096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:46.079382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.092734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.097145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.099122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a27cecfa-0433-41ad-8adc-f0f43b0bb874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.110930 Aug 24 17:40:46.104935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 47/87] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:45 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:46.154910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:46.155558 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:46.162470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.162998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.163431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.164117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.165283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.165707 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.331398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.338935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-25c82f5f-8745-4c13-850b-7bbcbc741f64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.187927 Aug 24 17:40:46.339511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 41/88] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:46 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:46.591014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:46.591628 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:46.597449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.597929 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.598369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.599054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.599504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.599928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.728230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.737702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-22b38fa2-d34b-4038-8281-518cf70bb5a6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.148640 Aug 24 17:40:46.744731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 48/89] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:46 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:46.815133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:46.816909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:46.823451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.823931 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.824358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.825244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.825699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.826116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.889760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.898085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-006e3fc8-cf67-49b0-91fd-07a1bed6c466 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.087571 Aug 24 17:40:46.898766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 42/90] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:46 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:47.122511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:47.123375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:47.129314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.129871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.130376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.131242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.131700 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.132124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.203363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.211485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.213024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.214159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d7c27e55-9788-4335-8a57-d7c8e0594ee6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.095580 Aug 24 17:40:47.214710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 49/91] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:47 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:47.359674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:47.360381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:47.362977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:47.363632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=30 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:47.369626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.370106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.370540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.371229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.371683 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.372106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.511982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.522243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-82fb7ad2-f195-40af-9099-e9809cdc3663 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.166383 Aug 24 17:40:47.523468 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 43/92] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:47 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:47.757514 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:47.758134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:47.764257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.764958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.765395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.766085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.766538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.766964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.919375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:47.920144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:47.924081 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.926933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.928321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.929025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.930350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.931012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.931654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.931859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a2b48aae-d9e6-40c8-8180-26d5d2e2bda2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.178075 Aug 24 17:40:47.937292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 50/93] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:47 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:48.002782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.010452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d909320b-7919-48a0-a80d-3c07eb80f621 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.095469 Aug 24 17:40:48.011011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 44/94] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:47 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:48.239510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:48.240083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:48.246306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.246779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.247211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.247896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.248345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.248792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.314921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.323396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.325937 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.327506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2b94cf52-cf64-48dc-9d0f-62e093de1683 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.093262 Aug 24 17:40:48.328702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 51/95] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:48 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:48.543214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:48.543849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:48.550104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.550588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.551017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.551869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.552470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.553134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.686709 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.694956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a9efae76-5dec-419f-96fb-b52c8f4f34f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.155205 Aug 24 17:40:48.695523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 45/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:48 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:48.951704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:48.952310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:48.958866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.959368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.959887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.960814 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.961291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.961713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.985126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=18 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:49.031947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:49.032573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:49.039923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.040236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.041107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.043010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.043689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.044317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.121289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.128899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e9c2b1cb-d7f9-447c-b5ba-4294530df125 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.100778 Aug 24 17:40:49.129465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 46/97] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:49 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:49.142919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.151048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c9ad7cf1-ddad-4762-b463-0213b4c8fabc tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.203097 Aug 24 17:40:49.151644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 52/98] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:48 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:49.356378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:49.357966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:49.365397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.365880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.366310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.367002 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.367452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.367890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.438610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.448341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.450109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.451256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9f495b09-3767-456e-955a-00aa43e1e453 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.102568 Aug 24 17:40:49.451843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 47/99] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:49 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:49.715032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:49.715641 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:49.717522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:49.722762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.723237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.723672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.724355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.724832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.725257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.861674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.869703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e772cd2e-3370-4ca8-b807-e1cac33319b4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.158400 Aug 24 17:40:49.870363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 53/100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:49 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:50.149281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:50.149890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:50.155834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.156307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.156784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.157464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.158419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.158835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.172332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:50.172979 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:50.179429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.179893 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.180321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.181029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.181475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.181892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.223759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.232541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-596cedf8-6bfc-465f-877b-bca24c3747e4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.086984 Aug 24 17:40:50.233876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 48/101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:50 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:50.315274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.322727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-017f812d-3388-4716-a97c-e899872b3655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.154315 Aug 24 17:40:50.323289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 54/102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:50 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:50.474677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:50.475211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:50.481130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.481611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.482039 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.482718 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.483165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.483582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.542469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.550428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.552040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.553158 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-26e3c8c8-29e4-4f91-936c-b2ae958e63d6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.083115 Aug 24 17:40:50.553711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 49/103] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:50 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:50.891685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:50.892210 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:50.898735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.899208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.899635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.900771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.900771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.901455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.030014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.037508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f21dd28e-cd69-419b-bc23-c9440e557333 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.149967 Aug 24 17:40:51.038075 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 55/104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:50 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:51.255265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:51.255797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:51.261950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.262430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.262864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.263546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.264001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.264418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.323123 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.330822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0713aab2-cd94-47ff-83f1-e961dcc861f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1245 microversion: 2.1 time: 0.080208 Aug 24 17:40:51.331391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 50/105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:51 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:51.343024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:51.343712 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:51.349588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.350059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.350482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.351152 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.351597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.352010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.541722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.549963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a806800d-a8e5-4171-944f-b1d39a2ca7ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.210717 Aug 24 17:40:51.550534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 56/106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:51 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:51.575223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:51.575831 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:51.582615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.583105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.583551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.584225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:51.584928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:51.585548 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:51.741067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.768777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.775514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:51.785156 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4766ac28-0e34-4718-b659-ba01b8a6807d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1286 microversion: 2.20 time: 0.205563 Aug 24 17:40:51.785777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 51/107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:51 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:52.058609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:52.059221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:52.061266 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:52.066462 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.066952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.067394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.068094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.068577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.069012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.353519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:52.354129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:52.360026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.360496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.361058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.361742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.362185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.362603 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.471773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.479238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2eb07674-1d02-4d3c-8454-595fd7e86900 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1293 microversion: 2.1 time: 0.130076 Aug 24 17:40:52.479797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 52/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:52 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:52.571487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:52.572099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:52.586579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.587082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.587558 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.588376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.588725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.591415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.597935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.606814 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-029266e5-541d-4fc4-bd8a-0f0b199f9d00 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.552491 Aug 24 17:40:52.607619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 57/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:52 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:52.807903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:52.808508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:52.814919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.815395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.815820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.816498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.816971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.817383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.889912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.898550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a074e10a-d489-491d-a3da-cc15f035e1c6 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.331166 Aug 24 17:40:52.899609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 53/110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:52 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:52.925332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.933393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.934885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.935968 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-56c66c5e-ee95-42d0-a095-ff2a6ec29a7f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1334 microversion: 2.20 time: 0.132031 Aug 24 17:40:52.936523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 58/111] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:52 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:53.202525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7040ce09-b5cc-4ec0-ae83-40302cb09bbd", "tag": "4929deee-0883-4917-b21f-5b0d9f785965"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:53.214377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.214847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.215273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Creating event network-changed:4929deee-0883-4917-b21f-5b0d9f785965 for instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd on hv-cinder-83538 Aug 24 17:40:53.235064 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:40:53.235450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e9a25937-4a06-44f0-ba8a-41747ef88f38 req-640cb173-1b0a-45cc-8508-7cc477730196 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:40:53.237043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.237490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.237907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.238599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.239037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.239446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.248005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.compute.rpcapi [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:40:53.248869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] Releasing lock "compute-rpcapi-router" {{(pid=127241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:40:53.263927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5ff16d63-727c-4075-852d-f4469ad1b2ee None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119893 Aug 24 17:40:53.264519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 54/112] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:53.500631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:53.501236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:53.507841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.508310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.508769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.509447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.509887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.510300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.570717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:53.578193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-12c9eb27-9a0d-4bac-8308-8ea95738b40a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1293 microversion: 2.1 time: 0.081465 Aug 24 17:40:53.578751 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 59/113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:53 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:53.627992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:53.628720 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:53.634782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.635261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.635694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.636380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.637122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.637548 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.767849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:53.775809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e23c7a3d-d5eb-4181-8d63-a75d4580d290 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.152650 Aug 24 17:40:53.776380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 55/114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:53 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:53.919736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:53.920670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:53.927709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.928198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.928670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.929371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.929827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.930250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.960765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:53.961383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:53.967362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.967841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.968276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.969065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.969523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.969948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.044387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.053254 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.054767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.055868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-15f1c554-16d4-4632-aa33-043f843aaad2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1334 microversion: 2.20 time: 0.099015 Aug 24 17:40:54.056442 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 56/115] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:53 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:40:54.087633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.096688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4c8e3906-ea1f-4dfa-92a2-90cd477fe64b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.179679 Aug 24 17:40:54.097570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 60/116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:53 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:54.599787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:54.599787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:54.608224 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.608753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.609199 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.612453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.612453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.612453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.641482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:54.693370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.703172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9df1b361-2ace-4249-a5ec-813b0bda8dcd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1293 microversion: 2.1 time: 0.107949 Aug 24 17:40:54.704543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 57/117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:54 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:54.796922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:54.797633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:54.803668 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.804166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.804604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.805310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.805759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.806197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.933121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.941399 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7e75d013-a89c-4341-bbee-4438c586d2f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.148779 Aug 24 17:40:54.941965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 61/118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:54 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:55.077733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:55.078342 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:55.084593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.085064 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.085495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.086181 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.086630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.087048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.117621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:55.118228 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:55.124200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.124709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.125176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.125856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.126306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.127349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.147341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.156783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.158284 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.159373 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f0b61e23-1e63-4ddb-a7ae-e51069f48f22 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1334 microversion: 2.20 time: 0.085492 Aug 24 17:40:55.160110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 58/119] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:55 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:55.256493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.264333 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5250793e-7661-4b09-bfcf-51f63fa1ec79 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.150472 Aug 24 17:40:55.264925 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 62/120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:55 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:55.281477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc136a1-7d8f-4741-bb10-b8b908a9b386", "tag": "42c7c19f-0268-4233-94df-3e98f490949d"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:55.291352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.291814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.292233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.303312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] Creating event network-changed:42c7c19f-0268-4233-94df-3e98f490949d for instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 on hv-cinder-83538 Aug 24 17:40:55.308333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a3880950-6bb9-443a-8eef-e348e594f2e0 req-86f71831-c22c-4e58-b370-3e853587e036 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030326 Aug 24 17:40:55.308951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 59/121] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:55.725829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:55.726434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:55.732375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.732883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.733309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.733982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.734588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.735014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.798597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.802202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:55.807326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0b6ceff6-8a26-4866-b3f9-d5831af6269b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1293 microversion: 2.1 time: 0.085339 Aug 24 17:40:55.807888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 63/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:55 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:55.962015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:55.962708 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:55.968860 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.969335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.969765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.971134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.971585 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.972009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.182357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:56.182972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:56.199609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.200149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.201202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.202244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.202716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.203148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.347307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.360779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-052d4f9f-8fdf-4b25-a8dd-b32c5ba33387 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.402795 Aug 24 17:40:56.362412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 60/123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:55 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:56.368000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:56.368834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:56.381338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.382007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.382602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.384044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.384672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.385427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.430158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.439322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.441033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.442333 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c92dcb2d-f8f7-4b74-9a88-09b6918ac9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1342 microversion: 2.20 time: 0.264091 Aug 24 17:40:56.442894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 64/124] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:56 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:40:56.553386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.560893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-abd7a73a-3de9-4260-8a48-cd7a5e81e242 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.197227 Aug 24 17:40:56.561458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 61/125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:56 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:56.829171 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:56.831015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:56.837989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.838598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.839248 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.840321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.842104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.842630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.043859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:57.052127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-49c95c3a-2f76-4fd2-896e-ae882628d991 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1299 microversion: 2.1 time: 0.228332 Aug 24 17:40:57.052910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 65/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:56 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:57.386799 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:57.387806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:57.399899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.400408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.400866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.401582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.402042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.402473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.465831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:57.466353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:57.478127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.478609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.479217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.480082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.480821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.481139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.697666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:57.706961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:57.709189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:57.710630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-166744d6-4816-4f0a-886f-9252c0ee786b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1340 microversion: 2.20 time: 0.248760 Aug 24 17:40:57.711966 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 66/127] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:57 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1340 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:57.723142 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:57.724357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:57.734380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.735035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.735658 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.737445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:57.738515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:57.738611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:57.970184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:57.980019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eecfaf75-3acc-4277-b0c8-43fa5aedea1e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.597142 Aug 24 17:40:57.981530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 62/128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:57 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:58.079336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:58.080753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:58.086360 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:58.102538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a59d17a3-eba2-44ec-8abe-04f9b135822b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.388601 Aug 24 17:40:58.106949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 67/129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:57 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:58.108138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:58.108772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:58.109310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:58.110114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:58.110851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:58.111441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:58.197908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:58.210827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e5f261b5-2e92-4116-bf7a-23c7f5badbd9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1299 microversion: 2.1 time: 0.138864 Aug 24 17:40:58.226295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 63/130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:58 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:58.739272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:58.741192 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:58.749490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:58.750060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:58.750578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:58.751185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:58.751689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:58.752124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:58.931803 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:58.941460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:58.946123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:58.947308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d47aa4bf-f116-4062-b9f6-dfc3f731180e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.214588 Aug 24 17:40:58.947866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 68/131] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:58 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:40:59.000853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:59.001465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:59.007352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.007835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.008271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.008999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.009453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.009873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.126434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:59.127896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:59.133727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.134202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.134630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.135639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.136263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.136713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.155003 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:59.163116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-17133e1e-bc9a-4c24-a587-76942937cc48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.165991 Aug 24 17:40:59.164600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 64/132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:58 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:59.233656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:59.234978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:59.245767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.246258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.246695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.249520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.250132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.251247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.272827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:59.282272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-73f0336c-7e89-4884-a8a9-bcb207dfdfd2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.160239 Aug 24 17:40:59.283510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 69/133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:59 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:59.386217 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:59.398110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-481a062e-4fd7-456a-95f3-f9385b8365c8 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.169038 Aug 24 17:40:59.398713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 65/134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:59 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:59.972005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:59.972726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:59.979262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.979834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.980263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:59.980975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:59.981427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:59.981869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.118020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.127923 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.129394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.130521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2a328436-5417-4f50-bd2e-482cfbc52972 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.163152 Aug 24 17:41:00.131067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 70/135] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:40:59 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:00.184398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:00.185050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:00.191149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.191631 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.192050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.192861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.193201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.193619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.303215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:00.303835 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:00.310103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.310869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.311309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.312054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.312515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.312956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.481930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.504969 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cafd01d6-5a9c-4035-a25d-e437a5aeca68 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.324098 Aug 24 17:41:00.516622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 66/136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:00 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:00.516622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:00.516622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:00.524707 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.525510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.526561 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.527519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:00.528146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:00.528908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:00.638267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.647750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8c7f98ce-e1f0-4e8a-831d-ac6e88c1c3d2 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.348151 Aug 24 17:41:00.648593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 71/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:00 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:00.806472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:00.815160 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4d2597ab-d6d4-469b-a9a5-a73626bb2b18 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.307068 Aug 24 17:41:00.815970 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 67/138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:00 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:01.029046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:01.040138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.040891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.041581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.054281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] Creating event network-changed:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:41:01.060205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-9c96fb06-61c2-4063-964d-5514739d8ec4 req-c7612226-2d90-46c2-8720-fe2ac46bbc66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034876 Aug 24 17:41:01.061069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 72/139] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:01.156368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:01.157188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:01.165483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.166127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.166845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.168238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.168981 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.169827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.401104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:01.409675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:01.411046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:01.412457 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-178e328a-0522-4349-a192-9073e27a3a60 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.262274 Aug 24 17:41:01.413178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 68/140] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:01 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:01.449603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db27e2e1-eafc-4042-ac32-131c956b188e", "tag": "72dcd75d-031e-4de4-95ca-13504315365d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:01.462474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.463659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.464247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.477852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] Creating event network-changed:72dcd75d-031e-4de4-95ca-13504315365d for instance db27e2e1-eafc-4042-ac32-131c956b188e on hv-cinder-83538 Aug 24 17:41:01.482416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-1e3d78a0-1f04-4288-8f51-9b88743fe4fa req-05581835-3fb1-43f3-8be1-58c21f8418c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037466 Aug 24 17:41:01.483005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 73/141] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:41:01.527185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:01.527730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:01.533805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.534293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.534729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.535416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.535869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.536291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.669791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:01.670487 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:01.676033 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:01.679412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.681568 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.682175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.683084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.683858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.684774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.690811 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fc12b301-281a-4133-bd69-a05ec5d1c362 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.165474 Aug 24 17:41:01.704778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 69/142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:01 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:01.840809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:01.841620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:01.849584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.849980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.850571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.851528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:01.852244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:01.852861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:01.966552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:01.975142 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c9aecc5e-8622-48c8-9fb2-5aca3eb20b08 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.309427 Aug 24 17:41:01.976074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 74/143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:01 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:02.009464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:02.017192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b75f5999-fa92-49a8-8788-a9b187917a6a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.180242 Aug 24 17:41:02.017729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 70/144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:01 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:02.435154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:02.435754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:02.441669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:02.442133 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:02.442586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:02.443258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:02.443703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:02.444120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:02.574705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:02.583276 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:02.584947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:02.586051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3582c82e-4004-4003-b58c-2cf5458c1c48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.154761 Aug 24 17:41:02.586825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 75/145] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:02 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:02.715312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:02.715980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:02.722758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:02.723329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:02.723833 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:02.724604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:02.725151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:02.725628 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:02.860356 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:02.870810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-082daa9d-d188-43fd-9e96-63b3ba6fb078 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.159753 Aug 24 17:41:02.871376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 71/146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:02 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:02.997271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:02.997953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:03.005359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.006098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.006541 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.007436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.008275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.008729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.038625 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:03.039681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:03.046247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.046747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.047171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.048077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.048588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.049012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.222739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:03.226331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:03.232433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-06362ba2-4110-44e6-98e7-608f360d7583 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.240212 Aug 24 17:41:03.233281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 76/147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:02 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:03.234432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c24cff2f-73a0-4a3f-a5cf-1d5cf5738e85 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.201184 Aug 24 17:41:03.235201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 72/148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:03 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:03.608844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:03.609454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:03.616688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.617174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.617608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.618301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.618751 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.619167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.755630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:03.764185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:03.765862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:03.767105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b71e156f-853c-43db-a1f1-83913296c9b8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.162080 Aug 24 17:41:03.767778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 77/149] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:03 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:03.891453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:03.892714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:03.894606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:03.900509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.901007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.901545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:03.902353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:03.902841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:03.903348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.058425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:04.070521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bb1725d0-9deb-4364-a90b-dba81f3449d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.183100 Aug 24 17:41:04.071145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 73/150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:03 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:04.255504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:04.256302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:04.258951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:04.259953 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:04.264894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.265717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.266480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.268689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.269745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.270754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.270867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.271369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.271746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.276985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.277413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.277849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.490091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:04.500933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-684773e1-9c4e-4f13-a106-4fe905bbec9a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.249625 Aug 24 17:41:04.505052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 78/151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:04 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:04.527483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:04.531003 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:04.536605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f8c9b7e0-fbdd-4b8a-9e83-3f8be399931a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.282188 Aug 24 17:41:04.537195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 74/152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:04 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:04.791737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:04.792961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:04.804146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.804681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.805176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:04.806037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:04.806594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:04.807048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.094768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:05.096603 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:05.119932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.121688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.122146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.124857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.125810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.126252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.348242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:05.375870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:05.385958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:05.390223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7dd6b6d7-9f3e-4976-a52e-44214e180464 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.603429 Aug 24 17:41:05.395631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 79/153] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:04 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:05.524853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:05.526047 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:05.538874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.541665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.542727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.545367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.546041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.547153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.654855 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:05.663142 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-933f8a35-9d9c-4b90-adb8-8eb0f6b7e10e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.575493 Aug 24 17:41:05.663725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 75/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:05 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:05.685031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:05.685692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:05.699936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.700434 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.700913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:05.701608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:05.702061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:05.702487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:06.280435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.297431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-643629c0-ff15-4c13-8d52-57aac9e60f68 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.777693 Aug 24 17:41:06.299677 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 80/155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:05 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:06.320687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.330532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9a9e48d9-e133-485d-a7a4-2fd402e63192 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.649186 Aug 24 17:41:06.331258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 76/156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:05 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:06.418574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:06.419275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:06.425873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:06.426417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:06.426930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:06.427618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:06.428070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:06.428481 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:06.572937 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.576701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:06.582623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.584123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.585318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c1acfe25-3126-4f61-9032-ab440255b7c6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.170974 Aug 24 17:41:06.586219 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 81/157] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:06 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:06.688676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:06.689323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:06.707387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:06.710033 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:06.711018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:06.716179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:06.719043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:06.721370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:06.935170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:06.944590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-18213509-3a74-4bb0-8c88-2d0e968b2e12 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.259801 Aug 24 17:41:06.945502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 77/158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:06 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:07.324509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:07.326928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:07.336574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.337263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.338064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.339158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.340340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.340811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.354277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:07.355658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:07.367193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.369385 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.370233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.372817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.374178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.376028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.650284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:07.653641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:07.670140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-966baff6-9b14-401f-b91d-b6025babfefa tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.353888 Aug 24 17:41:07.672316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 82/159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:07 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:07.676011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8c4db755-9eb8-4de6-8f5f-8a9c6214b14f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.324264 Aug 24 17:41:07.679391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 78/160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:07 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:07.682731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:07.683579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:07.694554 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.695669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.696475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.698278 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.699084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.700535 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.938971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:07.951033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:07.954165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:07.956513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7480e6aa-1a1e-4336-80ac-d54120a9c731 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.281339 Aug 24 17:41:07.965037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:07.966174 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:07.969941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 83/161] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:07 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:07.973989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.976151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.978349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:07.980754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:07.982305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:07.982999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:08.195650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:08.204390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-84c650e1-b395-4817-8bae-21ee267a6faa tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.243129 Aug 24 17:41:08.205798 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 79/162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:07 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:08.706492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:08.707692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:08.714872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:08.717904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:08.720369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:08.722548 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:08.723830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:08.724463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:08.921301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d6009a-fc4f-49b2-af48-abd6d89ab491", "name": "network-vif-plugged", "status": "completed", "tag": "8ccacc97-2951-4972-9663-04a38f8d6f29"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:08.940861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:08.941354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:08.941788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:08.973188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] Creating event network-vif-plugged:8ccacc97-2951-4972-9663-04a38f8d6f29 for instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 on hv-cinder-83538 Aug 24 17:41:08.981287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-1454b31e-9ac0-4aa3-9874-fd889b5d9d69 req-b1e16427-469a-41bb-8ebe-3a95672b9dec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380325 Aug 24 17:41:08.982900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 84/163] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:08.991448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:08.992314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:09.002594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.003329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.003908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.005047 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.006301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.007530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.024501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.035522 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fcba1756-0ae6-413d-a69f-cce1792db557 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.333286 Aug 24 17:41:09.036093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 80/164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:08 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:09.054431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:09.055043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:09.061381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.062132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.062800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.063784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.065144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.065647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.275509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.283486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1286e5ad-d5ac-4c82-9867-9e9bb05f7a30 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.298910 Aug 24 17:41:09.293327 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.299978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 85/165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:08 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:09.305837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:09.306657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:09.307830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.310497 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.312264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-87f0c7fe-1788-4bfe-a378-9a5b88b6a480 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.261605 Aug 24 17:41:09.313369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 81/166] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:09 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:09.314651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.315311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.315743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.316483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:09.316996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:09.317419 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:09.530358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:09.543615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c23c83f5-25f6-4859-9229-58efd6c8f9fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.241894 Aug 24 17:41:09.558953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 86/167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:09 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:10.057333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:10.058695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:10.067010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.067678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.068255 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.069283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.069880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.070452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.222672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.230576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cec3d4e7-415f-47c4-a9b7-b93ab349bb30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.178666 Aug 24 17:41:10.245227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 82/168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:10 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:10.306042 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:10.306643 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:10.317338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.318863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.320987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.322390 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.323053 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.323846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.335985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:10.336719 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:10.339804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:10.346786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.351344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.353099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.353861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.354339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.355272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.574673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.582539 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0617705a-7ea3-4e0e-9e90-61a61ac5517f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.280329 Aug 24 17:41:10.584357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 87/169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:10 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:10.597573 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:10.600267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:10.610437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.610956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.611924 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.612652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:10.613109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:10.613532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:10.639894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.649414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.651109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.652339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-26f88c1e-13d7-4841-894e-fd25b222c27c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.320803 Aug 24 17:41:10.660601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 83/170] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:10 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:10.764570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:10.773780 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a00a6049-9b66-415d-8abc-8651cb73a6e8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.185416 Aug 24 17:41:10.774355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 88/171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:10 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:11.251001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:11.252140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:11.261885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.263004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.265146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:11.267818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.268450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.270361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:11.518715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:11.528641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ef40ed92-f396-465c-8095-7d9c06d8918f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.281038 Aug 24 17:41:11.529531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 84/172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:11 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:11.607646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:11.608253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:11.618720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.627862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.628196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:11.628958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.629887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.629887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:11.679005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:11.679904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:11.691492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.691989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.694818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:11.697726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:11.698616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:11.699251 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:12.066577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.071761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.078485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0f8da2b4-267b-4bf5-a912-c7d3d32e5d4f tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.474909 Aug 24 17:41:12.082935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.084960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.086735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e5518c8a-84e3-4b0a-9613-f659db6c625c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.415273 Aug 24 17:41:12.087801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 85/174] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:11 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:12.092907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 89/174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:11 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:12.114112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:12.115277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:12.143220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:12.149690 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:12.150161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:12.154688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:12.155226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:12.155635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:12.364500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.373581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4bd8898c-52cc-4988-9d70-136324d7f818 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.284601 Aug 24 17:41:12.374673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 86/175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:12 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:12.548965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:12.549755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:12.560455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:12.561621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:12.566851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:12.567756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:12.568427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:12.569548 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:12.733906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:12.742790 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1889c22e-46e3-4022-a995-d041fde29139 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.197857 Aug 24 17:41:12.756471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 90/176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:12 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:13.104328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:13.106620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:13.117128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.118043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.118909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.119971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.120414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:13.120643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.121156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:13.121541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.136543 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.137301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.138148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.139038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.142411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.143620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.414565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:13.425033 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e4457f55-7946-464a-928e-b285aa1063c3 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.326299 Aug 24 17:41:13.425838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 87/177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:13 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:13.444933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:13.445700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:13.449178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:13.454062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.454559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.454991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.455848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.456430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.457053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.458715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:13.460674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:13.462086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6de826d0-be2f-4592-8fdc-b987bf64c3af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.349996 Aug 24 17:41:13.463241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 91/178] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:13 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:13.673179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:13.681465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8beff71f-2de9-4dc7-bc4a-854c13b72a86 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.241229 Aug 24 17:41:13.682437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 88/179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:13 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:13.763760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:13.764780 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:13.772437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.773238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.773846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:13.775245 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:13.775854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:13.776429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.024882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:14.033357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0040238b-e2fc-455f-bc81-0c1f4b89a358 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.273328 Aug 24 17:41:14.033943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 92/180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:13 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:14.446194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:14.446811 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:14.457592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.458110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.458570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.459308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.459760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.460180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.487316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:14.487928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:14.505001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.505615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.506057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.506776 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.507232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.507654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.854702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:14.865724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:14.867655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:14.869954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c2156352-b871-4f56-991c-7f4fbac685c0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.386900 Aug 24 17:41:14.871073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 93/181] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:14 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:14.876190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:14.877072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:14.883838 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.884580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.885891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.887082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:14.887467 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:14.888243 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:14.922579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:14.932036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-411f13c3-2552-4fff-83dc-ae71a746de4a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.489752 Aug 24 17:41:14.932630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 89/182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:14 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:15.054677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:15.055288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:15.063926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.064464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.064929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:15.065633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.068166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.068630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:15.072995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:15.095867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5f44c2c6-4736-4bc7-8df6-88321350012a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.221770 Aug 24 17:41:15.098576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 94/183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:14 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:15.284333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:15.293229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1a6391de-5724-42ba-a2ad-e8a0a91142c7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.242308 Aug 24 17:41:15.293810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 90/184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:15 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:15.896247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:15.897665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:15.906207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.907288 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.908112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:15.909180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.909903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.914658 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:15.957769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:15.958498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:15.968676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.969202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.969649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:15.970428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:15.970890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:15.971313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:16.025359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:16.448203 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:16.459250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:16.460983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:16.462269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-849037c8-e9b8-40a4-b597-24f47e13a978 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.572011 Aug 24 17:41:16.468820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:16.469189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 95/185] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:15 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:16.483874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f8094663-5cbb-44c2-8b40-9f4c692f28c1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.532591 Aug 24 17:41:16.489361 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:16.490066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:16.499404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 91/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:15 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:16.504692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:16.505686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:16.508761 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:16.508933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:16.509711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:16.510070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:16.510522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:16.510948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:16.514107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:16.514787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:16.516188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:16.517416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:16.518371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:16.519111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:17.219639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.232356 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c5790c0d-be2d-4c9f-a7dc-52fe917dc873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.729875 Aug 24 17:41:17.241179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:16 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:17.264629 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.281407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-98fa740f-9216-452a-b3af-226adcd3527a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.807141 Aug 24 17:41:17.282299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 96/188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:16 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:17.487116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:17.487952 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:17.495025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:17.499885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:17.500435 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:17.507502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:17.508311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:17.515390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:17.517043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:17.520601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:17.522187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:17.528447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:17.530707 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:17.532062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:17.533704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:17.537013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:17.862253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.871316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4f536d91-91d8-4086-9c84-1f0456c8e655 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.368474 Aug 24 17:41:17.883081 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 97/189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:17 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:17.913936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.925283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.928843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:17.930741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ca000f2a-5e29-453f-9a59-ecc01ab8fade tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.448387 Aug 24 17:41:17.931857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 93/190] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:17 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:18.258611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:18.259901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:18.274302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.275424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.280203 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.281201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.281815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.284059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.304059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:18.305853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:18.318770 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.319892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.321280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.326365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.327076 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.328825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.577484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:18.585898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a5f2a3cb-d0d9-43de-b33d-89ae108ffdaf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.286423 Aug 24 17:41:18.596954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 94/191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:18 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:18.602316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:18.618525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f0eabb0e-ffa3-4f35-b811-3a321469c92a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.367527 Aug 24 17:41:18.636375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 98/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:18 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:18.896425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:18.897091 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:18.905103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.905647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.906088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.906788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.907243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.908221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.954029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:18.954639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:18.961103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.961819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.963654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.965023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:18.966178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:18.966854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:18.974837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:19.246824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:19.259252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-15a431b7-64c6-4546-87b3-0223c2023514 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.368272 Aug 24 17:41:19.273974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:19.274993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 95/193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:18 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:19.291203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc136a1-7d8f-4741-bb10-b8b908a9b386", "name": "network-vif-plugged", "status": "completed", "tag": "42c7c19f-0268-4233-94df-3e98f490949d"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:19.294785 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:19.300385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:19.302470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:19.303464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:19.304429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:19.305232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1bea5853-9d99-441c-83e7-3e20f9db85fd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.353863 Aug 24 17:41:19.307394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 99/194] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:18 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:19.330308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] Creating event network-vif-plugged:42c7c19f-0268-4233-94df-3e98f490949d for instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 on hv-cinder-83538 Aug 24 17:41:19.336313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-cd85818e-a550-4fee-a224-c287a9b68f78 req-adde81e7-81a1-4882-9c32-68a45b02276e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056020 Aug 24 17:41:19.337253 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 96/195] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:19.607871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:19.608828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:19.616323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:19.617069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:19.617655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:19.618753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:19.619357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:19.619964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:19.645750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:19.646739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:19.660234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:19.661148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:19.661853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:19.663215 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:19.665841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:19.666666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:20.013256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.029138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4bea64c1-d3c7-46e9-8f8c-f25810ff02b1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.425576 Aug 24 17:41:20.033384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 100/196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:19 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:20.044412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.057375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f4536fd0-a4f0-4cd9-b3bb-837a13ad8770 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.415823 Aug 24 17:41:20.057973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 97/197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:19 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:20.296769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:20.297384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:20.310664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:20.311498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:20.312412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:20.314654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:20.315406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:20.316747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:20.330354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:20.331759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:20.347550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:20.350327 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:20.351050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:20.352944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:20.354514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:20.355200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:20.688741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.698348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0c478ecb-8f90-43f2-b125-64b26074d60c tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.405639 Aug 24 17:41:20.701675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 101/198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:20 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:20.711233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.721419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.722964 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:20.724087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-53dd8dac-5a8a-4806-bf36-9ab22d088dd7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.400244 Aug 24 17:41:20.724668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 98/199] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:20 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:21.057818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:21.058755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:21.067116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.069179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.070812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.071810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.074045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.076472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.081477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:21.082306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:21.094772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.096260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.098038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.099610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.101785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.103794 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.536793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:21.545196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a732dbf0-10d5-464b-be4b-4be6ab0b77fd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1321 microversion: 2.1 time: 0.492917 Aug 24 17:41:21.579325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 102/200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:21 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:21.584068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:21.592180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7040ce09-b5cc-4ec0-ae83-40302cb09bbd", "name": "network-vif-plugged", "status": "completed", "tag": "4929deee-0883-4917-b21f-5b0d9f785965"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:21.605623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8a0f76d2-6701-4bfa-bb2e-db35195acd27 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.530124 Aug 24 17:41:21.610423 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 99/201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:21 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:21.627944 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.631635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.632249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.652332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] Creating event network-vif-plugged:4929deee-0883-4917-b21f-5b0d9f785965 for instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd on hv-cinder-83538 Aug 24 17:41:21.661484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-8d345a60-6804-4998-97af-864d42d9c7f7 req-31e298e4-2a51-4fb0-aba6-f6ad75a36970 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079278 Aug 24 17:41:21.662246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 103/202] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:21.731013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:21.732166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:21.749151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.749351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:21.750260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:21.750851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.751443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.753184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.754318 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.755682 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.771065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.771831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.773234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:21.774139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:21.774767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:21.785153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:22.323249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:22.337283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:22.338845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:22.339999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c8b0c180-61e8-41fb-acfe-374d92494b9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.596813 Aug 24 17:41:22.351042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:22.359231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a46931fd-ddcd-4bc6-a8d2-e3cb2b37fde0 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1315 microversion: 2.1 time: 0.639306 Aug 24 17:41:22.362255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 104/203] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:21 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:22.363065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 100/204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:21 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:22.566614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:22.567800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:22.570033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=96 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:22.598591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:22.603100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:22.605960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:22.610475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:22.614763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:22.616776 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:22.633176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:22.634401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:22.643876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:22.667569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:22.668052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:22.672966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:22.674915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:22.682800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:23.498502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:23.509236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-00ac93a8-0218-48ed-b485-c939d1141040 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.879440 Aug 24 17:41:23.510556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 101/205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:22 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:23.519584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:23.521519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:23.528272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:23.528912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:23.530414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:23.531513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:23.532352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:23.533068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:23.625593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:23.646577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d881b2a0-c78e-40a3-b88b-4baed63b55a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1516 microversion: 2.1 time: 1.080858 Aug 24 17:41:23.649782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 105/206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:22 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1516 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:23.678314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:23.685367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:23.703834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:23.704645 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:23.706895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:23.707858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:23.708458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:23.709626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:23.946088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:23.957199 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-39273bdd-6fb2-45c1-89e6-11c71fdaf48b tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1502 microversion: 2.1 time: 0.445451 Aug 24 17:41:23.961056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 102/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:23 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:23.971057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:23.979704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:23.997593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:23.999610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.001067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.002030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.004497 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.005127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.155179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:24.171473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:24.175349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lazy-loading 'flavor' on Instance uuid d6d6009a-fc4f-49b2-af48-abd6d89ab491 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:41:24.177873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:24.182181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-57f14566-d072-4f31-becc-11e0dc09770e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.527851 Aug 24 17:41:24.182896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 106/208] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:23 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:24.198842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db27e2e1-eafc-4042-ac32-131c956b188e", "name": "network-vif-plugged", "status": "completed", "tag": "72dcd75d-031e-4de4-95ca-13504315365d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:24.216990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.217711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.218447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.236076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] Creating event network-vif-plugged:72dcd75d-031e-4de4-95ca-13504315365d for instance db27e2e1-eafc-4042-ac32-131c956b188e on hv-cinder-83538 Aug 24 17:41:24.247930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-2d61c69c-a583-4873-98c0-6fa64f7dda63 req-2de08421-82c9-4919-8bea-41732806285e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062700 Aug 24 17:41:24.250267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 107/209] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:24.438496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f70447d3-f690-4398-9cec-5a0b39c0ee49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491/action" status: 200 len: 32 microversion: 2.1 time: 0.474669 Aug 24 17:41:24.445291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 103/210] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:41:23 2022] POST /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491/action => generated 32 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:41:24.462559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:24.463407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:24.480307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.480819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.481349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.485671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.486733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.488326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.531749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:24.532471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:24.550092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.561539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.562153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.565632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.566116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.567864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:25.011134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:25.016180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:25.034375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1188f439-4aa0-4bec-8a53-f8545685ac92 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.506903 Aug 24 17:41:25.036516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8e87f3fc-2834-478f-9278-b7bd1b984d58 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.589076 Aug 24 17:41:25.037145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 108/211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:24 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:25.050530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 104/212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:24 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:25.208009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:25.208665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:25.219236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:25.221663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:25.226453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:25.227620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:25.228284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:25.228921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:25.909849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:25.924114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:25.926242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:25.927631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dabb617a-8491-4814-9dc4-39ac63b30e41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.724030 Aug 24 17:41:25.928443 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 109/213] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:25 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:26.059991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:26.061291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:26.069718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.073311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.074575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:26.075459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.076936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.078577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:26.262008 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:26.273388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d3c7c2aa-a826-4a6a-8595-8d1a378c9bd1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.217709 Aug 24 17:41:26.277760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 110/214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:26 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:26.291315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:26.291941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:26.300118 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.300640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.301445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:26.302301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.303100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.303984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:26.434594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-51e29023-9d03-490f-a9dc-2bf7843b4741 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Action: 'create', calling method: .version_select at 0x7fa66c071dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1534415720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9R1jZWN94Tcmcyhcz8R8eI8LsmW1gzalCizLwY803tXYMnVxKRmgTlrl0neKrYAC8VJoZKkifcvNGiwTVhIU6fjpTL6WVmoWLcVkJOUktwOxFzM0AKMRN3biPg/zYPNg=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:26.459018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-51e29023-9d03-490f-a9dc-2bf7843b4741 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for project 87a610c98b9b48bd96d2954604bf3078. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:41:26.463678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-51e29023-9d03-490f-a9dc-2bf7843b4741 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for user af6710bfe62d4ba29dc48e2f7aba9ec5 and project 87a610c98b9b48bd96d2954604bf3078. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:41:26.470702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:26.478581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-97958694-1502-4cab-8eb4-0ecbc79327d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.199246 Aug 24 17:41:26.489934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-51e29023-9d03-490f-a9dc-2bf7843b4741 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.459060 Aug 24 17:41:26.490770 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 105/215] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:41:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:26.492978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 111/216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:26 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:26.953747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:26.954753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:26.962052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.963105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.963691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:26.965203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:26.965807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:26.966374 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:27.163886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:27.174964 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:27.181021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:27.182161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7678d837-7471-4a50-ab97-6ba7a289fd9c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.236241 Aug 24 17:41:27.184859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 106/217] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:26 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:27.294280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:27.295593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:27.306292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:27.307031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:27.307468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:27.308172 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:27.308653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:27.311416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:27.506140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:27.506752 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:27.516868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:27.518896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:27.519938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:27.521475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:27.524481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:27.525118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:27.772253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:27.780408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8d005516-1137-41de-8ac9-924ac776c968 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.489906 Aug 24 17:41:27.781015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 112/218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:27 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:27.859382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:27.863529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:27.870568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d0c2d838-58d2-4f13-aa1b-5226681e0714 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.368395 Aug 24 17:41:27.881502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 107/219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:27 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:28.066373 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "258e9d3a-c5b8-4229-9842-546e35d87d2c"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:28.069737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:28.076365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.077151 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.077805 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:28.078709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.079373 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.080046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:28.208843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:28.209939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:28.219832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.220948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.221678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:28.222771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.223432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.224152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:28.444924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:28.460731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:28.464043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:28.465647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1c67d2f1-dbcc-4fad-a2c1-6b5c2d414aed tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.264398 Aug 24 17:41:28.466241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 108/220] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:28 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:28.809783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:28.811074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:28.820330 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.820986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.822062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:28.823006 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:28.823821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:28.824314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:29.135658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:29.147944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8130fe94-4a6b-482d-837e-48c3ab00885a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.344171 Aug 24 17:41:29.161742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 109/221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:28 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:29.166909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:29.167724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:29.174171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:29.174912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:29.176055 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:29.180319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:29.181106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:29.181759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:29.356929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:29.366126 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-868ef5d5-1703-4d4f-bfb9-263466415930 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.202986 Aug 24 17:41:29.368583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 110/222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:29 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:29.503415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:29.508045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:29.521250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:29.522044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:29.522741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:29.524008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:29.525066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:29.526195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:29.745990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:29.759649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:29.762509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:29.764590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-503be818-75b4-41ff-82ea-4f7c094e8a3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.276331 Aug 24 17:41:29.765473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 111/223] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:29 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:30.169127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:30.170589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:30.177472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.182931 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.183379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.184349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.186785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.187287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.379870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:30.393350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-835dab17-1a8c-4ca3-a253-7c6d803cf167 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.227929 Aug 24 17:41:30.394010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 112/224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:30 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:30.401673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:30.403150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:30.411391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.411879 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.412610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.413539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.414051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.414692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.626508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:30.635387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-973efa8b-5ce4-4cc7-be3c-c6d2a20d5b5e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.240095 Aug 24 17:41:30.635963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 113/225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:30 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:30.789938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:30.790783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:30.796916 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.797393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.797818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.798792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:30.799395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:30.799818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:30.942705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:30.953509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:30.955459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:30.956784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-80fd4551-14f2-494d-9c13-bb98a7fef22d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.170938 Aug 24 17:41:30.957350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 114/226] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:30 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:31.414826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:31.415866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:31.421374 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.422030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.422601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:31.423474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.424705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.425449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:31.588347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:31.598314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2635c625-e0f2-4b6f-af24-c78d60aabb36 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.187519 Aug 24 17:41:31.612985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 115/227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:31 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:31.659677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:31.660226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:31.668120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.669066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.669500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:31.670274 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.670641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.671115 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:31.840490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:31.851009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7840cb55-c1ab-4f58-b7f0-81c7023be36d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.196737 Aug 24 17:41:31.855706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 116/228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:31 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:31.983663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:31.984272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:31.992227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.992825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.993202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:31.993905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:31.994352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:31.994768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:32.174403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:32.191011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:32.192724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:32.194979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5fba8f21-f3e9-494a-9606-38e493dbfa01 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.216751 Aug 24 17:41:32.197339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 117/229] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:31 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:41:32.340871 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "name": "network-vif-plugged", "status": "completed", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:32.355624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:32.356494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:32.357327 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:32.387300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] Creating event network-vif-plugged:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:41:32.401647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a0b9d78b-11f0-47cd-8283-ab79c003f4c4 req-05988c50-dd32-42f1-89e2-0b923f9f175d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066722 Aug 24 17:41:32.402259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 118/230] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:32.620598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:32.621427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:32.629467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:32.630196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:32.630687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:32.631680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:32.632131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:32.632805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:32.871427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:32.884854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9d3010a5-c051-4196-811d-2c0551357535 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.264709 Aug 24 17:41:32.888120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 119/231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:32 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:32.912095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:32.915786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:32.934380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:32.935150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:32.936214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:32.945843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:32.946804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:32.947445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:33.163769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:33.173991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3661f0c1-3645-4521-9f5e-b69d377390dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.284136 Aug 24 17:41:33.175272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 120/232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:32 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:33.206484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e541b2be-eede-40ae-9587-a569892ad5a1 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "POST /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.144783 Aug 24 17:41:33.207439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 113/233] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:41:28 2022] POST /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386/os-volume_attachments => generated 194 bytes in 5146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:33.225665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:33.226410 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:33.232989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:33.233472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:33.233900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:33.234590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:33.235044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:33.235469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:33.445640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:33.460403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:33.463157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:33.465432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-570017fa-f495-423d-9305-b7c076fb5882 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.249260 Aug 24 17:41:33.466518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 121/234] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:33 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:33.908728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:33.910179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:33.918235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:33.927147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:33.927856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:33.929624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:33.932256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:33.932956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:34.150111 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:34.157844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-86baf574-50c0-4fd3-a1ee-43f19a7ddc10 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.254006 Aug 24 17:41:34.158456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 114/235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:33 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:34.196028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:34.197270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:34.203280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:34.203761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:34.204399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:34.205763 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:34.206382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:34.206808 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:34.365521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:34.374583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-af1dd8d9-1a62-46de-887d-940f39d912a5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.182561 Aug 24 17:41:34.375675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 122/236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:34 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:34.487920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:34.489552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:34.497488 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:34.497973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:34.498402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:34.499148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:34.499967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:34.500691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:34.652508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:34.656496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:34.690379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:34.696425 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:34.706087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2fd97788-82aa-49ac-9762-037e6e4a7c4a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.222054 Aug 24 17:41:34.707321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 115/237] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:34 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:35.178710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:35.179368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:35.185835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.186319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.186826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.187504 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.187957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.188378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.333587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:35.341537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2ab7d63c-11a5-4cfa-b409-4b1be27f37e5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1366 microversion: 2.1 time: 0.166784 Aug 24 17:41:35.342105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 123/238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:35 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:35.409656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:35.410327 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:35.417809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.418286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.418722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.419413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.419865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.420287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.582080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:35.589727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-90baffdf-1d94-4070-9ad1-fbeae35bf4ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.184660 Aug 24 17:41:35.590286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 116/239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:35 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:35.728775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:35.729295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:35.735122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.735585 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.736010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.736761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:35.737203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:35.737615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:35.873378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:35.882360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:35.883840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:35.885044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ff6db04b-29ad-4e11-8d39-8fe28100988b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1407 microversion: 2.20 time: 0.160291 Aug 24 17:41:35.885500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 124/240] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:35 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:36.363893 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:36.364806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:36.371006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.371671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.372335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.373279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.373800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.374294 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.515156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:36.522837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9222e1b5-7bf3-4a77-ad54-c9e3a6468ddc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1556 microversion: 2.1 time: 0.163599 Aug 24 17:41:36.523411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 117/241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:36 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:36.544982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:36.545563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:36.547604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:36.553903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.554370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.554979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.555680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.556165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.556580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.564851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:36.612041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:36.613831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:36.619860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.620353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.621069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.622073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.622513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.623541 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.655287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0b48a871-0109-45ed-8483-ffbb1840ec30 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114411 Aug 24 17:41:36.655872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 125/242] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:41:36 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:41:36.815351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:36.824621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d786b21-a578-42b9-97a0-fafbfec6c0a4 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.217161 Aug 24 17:41:36.825463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 118/243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:36 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:36.913723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:36.914363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:36.921617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.922184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.922715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:36.923535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:36.924089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:36.924729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:37.109517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:37.117982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:37.119642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:37.120813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c99302e1-afe8-4d0c-894d-5fed7e72cbfc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1598 microversion: 2.20 time: 0.217513 Aug 24 17:41:37.121402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 126/244] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:41:36 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1598 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:37.144252 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:37.144948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:37.151311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:37.151620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:37.152055 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:37.152794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:37.153269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:37.153700 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:37.236356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bb7489b0-450e-4e20-8f40-4480808998c2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096441 Aug 24 17:41:37.237159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 119/245] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 24 17:41:37 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:37.855209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:37.857260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:37.870085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:37.870901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:37.871784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:37.872813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:37.873519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:37.874296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:38.318946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:38.341528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d6d987f9-a225-493e-94f3-800e35e01885 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.486462 Aug 24 17:41:38.344727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 127/246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:37 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:38.399851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db27e2e1-eafc-4042-ac32-131c956b188e", "tag": "72dcd75d-031e-4de4-95ca-13504315365d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:38.414732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:38.418126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:38.419923 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:38.449201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] Creating event network-changed:72dcd75d-031e-4de4-95ca-13504315365d for instance db27e2e1-eafc-4042-ac32-131c956b188e on hv-cinder-83538 Aug 24 17:41:38.457153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-15c95b85-67aa-4754-8338-0f8b420eb0a1 req-d9f1f5a1-10e4-468a-b734-a834e19eb6ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061069 Aug 24 17:41:38.458815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 120/247] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:38.987931 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:38.993642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:39.010193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:39.014609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:39.015089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:39.053447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] Creating event network-changed:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:41:39.071375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-18029a97-99f4-41d6-998f-e9f4c1d9219f req-8a89d14c-c350-4a9a-a001-a7ec1f00d15d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086468 Aug 24 17:41:39.072193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 128/248] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:39.366752 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:39.367703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:39.377947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:39.378844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:39.379439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:39.380462 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:39.381087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:39.381795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:39.678169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:39.691671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ffe73dfc-30d4-4148-8847-0c57af3fd702 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.330283 Aug 24 17:41:39.694133 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 121/249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:39 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:40.716832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:40.718040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:40.728204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:40.729109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:40.730222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:40.734903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:40.735809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:40.736806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:40.917421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:40.925741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-045ea96f-4b61-4515-90c1-aa976fc95088 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.215211 Aug 24 17:41:40.926300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 129/250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:40 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:41.947019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:41.948256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:41.954835 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:41.955977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:41.956508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:41.957221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:41.957730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:41.958109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:42.091176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:42.098801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e8accfbb-34e1-410f-97b2-886422c37f1b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.155907 Aug 24 17:41:42.099369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 122/251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:41 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:43.119324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:43.119957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:43.126817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:43.127819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:43.128526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:43.129473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:43.130130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:43.130756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:43.276474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:43.284854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-31d4c537-6c70-4694-85a8-2398e9e4136b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.169461 Aug 24 17:41:43.285510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 130/252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:43 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:44.306643 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:44.307326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:44.313750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:44.314802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:44.315306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:44.316077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:44.316625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:44.317072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:44.537817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:44.548254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fea946cb-0c66-4807-960b-d4378461d27c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.245414 Aug 24 17:41:44.549500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 123/253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:44 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:45.571586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:45.572200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:45.578189 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:45.578667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:45.579097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:45.579787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:45.580238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:45.580693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:45.731031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:45.739934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cc716081-5b39-48fd-9924-23ebb5bcce90 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.172252 Aug 24 17:41:45.740505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 131/254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:45 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:46.767889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:46.768427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:46.775686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:46.776203 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:46.776686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:46.777392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:46.777846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:46.778393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:46.908493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:46.917254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-aba37616-e713-4f5c-8fbe-2ed6474acf1c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.153768 Aug 24 17:41:46.917821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 124/255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:46 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:47.938660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:47.939477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:47.946044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:47.946529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:47.946959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:47.947661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:47.948111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:47.948729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:48.074990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:48.083246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a033bae3-e2df-4c9a-8e6e-e754c9c30ded tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.148071 Aug 24 17:41:48.083811 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 132/256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:47 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:49.105675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:49.106398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:49.113597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:49.114088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:49.114602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:49.115842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:49.116301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:49.116765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:49.253160 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:49.261445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1613bf43-8fe5-4521-8f7c-a5dbae9ad69c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.159702 Aug 24 17:41:49.262016 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 125/257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:49 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:50.282856 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:50.283458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:50.289236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:50.289820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:50.290307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:50.291035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:50.291476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:50.291900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:50.423668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:50.431926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0b6bb4c5-5c48-47ad-9151-94b9f140e860 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.153040 Aug 24 17:41:50.432486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 133/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:50 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:51.453211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:51.453819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:51.460194 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:51.460714 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:51.461144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:51.461829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:51.462914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:51.463338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:51.596044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:51.603715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4fa13d8a-6fa7-4f68-bf6f-c8d874778447 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.154324 Aug 24 17:41:51.604276 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 126/259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:51 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:52.624572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:52.625176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:52.631016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:52.631486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:52.631913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:52.632623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:52.633068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:52.633481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:52.759978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:52.767753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cfc428df-7272-49b1-a94c-e229af69168e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.147161 Aug 24 17:41:52.768310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 134/260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:52 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:53.789396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:53.789999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:53.792460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=44 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:53.798064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:53.798571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:53.799007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:53.799704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:53.800191 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:53.800672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:53.931394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:53.940913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dc9e18fc-29d8-4f21-bfc1-aac8d2094611 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.155195 Aug 24 17:41:53.941601 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 127/261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:53 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:54.962944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:54.964040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:54.969941 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:54.970412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:54.970834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:54.971503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:54.971982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:54.972400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:55.101116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:55.109619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-72e52368-ed7a-4a8b-b7b3-d9bfece83e01 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.150459 Aug 24 17:41:55.110169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 135/262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:54 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:56.130116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:56.130750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:56.137220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:56.137702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:56.138134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:56.138823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:56.139271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:56.139943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:56.268587 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:56.277122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-af0939fe-1c9a-452d-bce3-7efa043150eb tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.150831 Aug 24 17:41:56.277693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 128/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:56 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:57.297863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:57.298467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:57.304574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:57.305099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:57.305532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:57.306227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:57.306677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:57.307607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:57.516298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:57.524986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f24dac7c-5ac3-4f88-a441-a53715ca1c8a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.230868 Aug 24 17:41:57.525553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 136/264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:57 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:58.271447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:58.272016 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:58.279334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.279949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.280455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.281178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.281629 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.282051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.306921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:41:58.403947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-16c26572-18a4-4368-89ca-5fb94eb46a35 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 204 len: 0 microversion: 2.1 time: 0.136514 Aug 24 17:41:58.404537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 129/265] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:41:58 2022] DELETE /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:41:58.413311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:58.413910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:58.419703 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.420178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.420670 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.421355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.421797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.422323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.556519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:58.558159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:58.568863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.570339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.570903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.572509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:58.574056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:58.575233 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:58.854693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:58.856877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:41:58.862738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b7a0060e-ccb1-414e-8f10-66b8952c05ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.312977 Aug 24 17:41:58.863302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 130/266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:58 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:58.865251 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-52f7ba87-29a7-485d-b8e3-116028b3dd80 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1554 microversion: 2.1 time: 0.456112 Aug 24 17:41:58.865973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 137/267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:58 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1554 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:59.884352 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.884946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:59.892545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.892545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:59.893033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:59.893033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:59.893033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:59.893678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:59.894131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:59.894556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:59.899994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:59.900640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:59.901145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:59.902051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:59.902577 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:59.903070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:00.112656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:00.116526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:00.120273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:00.121268 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ec18e7b3-84dd-482a-8641-c10074c8a408 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1554 microversion: 2.1 time: 0.236413 Aug 24 17:42:00.122045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 138/268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:00.131685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-28a49739-f132-4dd2-87c1-3cf000eb1709 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.252242 Aug 24 17:42:00.132422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 131/269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:01.142330 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.142940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:01.149222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:01.149894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:01.150324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:01.151769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:01.152372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:01.152966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:01.156064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.156837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:01.166376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:01.166998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:01.167537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:01.168332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:01.169553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:01.170308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:01.383161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:01.390444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:01.398231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f56ba4e0-6a4f-4512-8037-2edfa972e5da tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.248865 Aug 24 17:42:01.398575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9a58a8dc-d146-4226-ae2e-93d09411fa3a tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1554 microversion: 2.1 time: 0.260025 Aug 24 17:42:01.399130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 132/270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:01 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:01.399545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 139/271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:01 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:02.226845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc136a1-7d8f-4741-bb10-b8b908a9b386", "name": "network-vif-deleted", "tag": "42c7c19f-0268-4233-94df-3e98f490949d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:02.246159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:02.247887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:02.251870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:02.271492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] Creating event network-vif-deleted:42c7c19f-0268-4233-94df-3e98f490949d for instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 on hv-cinder-83538 Aug 24 17:42:02.279577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-84a6c059-6541-467e-bc68-c9716905d2f4 req-e4dec817-7e6d-488a-ad05-224c819fb824 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057199 Aug 24 17:42:02.281052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 133/272] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:02.421119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.422862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:02.422985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.423758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:02.430307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:02.430856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:02.431426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:02.432388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:02.432933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:02.433423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:02.435057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:02.435715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:02.436315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:02.437656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:02.439481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:02.440120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:02.561361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0ae308269b4cdd80990f7b38c0cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9206de8ce97b425cb5c675ec0a240d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:02.570882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ea01fd24-2dd2-4752-8610-0590f5842392 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 200 len: 1346 microversion: 2.1 time: 0.154671 Aug 24 17:42:02.571681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 140/273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 1346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:02.656653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:02.665299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-decbe93f-cb69-40ca-bd06-7aea605b4912 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.248242 Aug 24 17:42:02.673364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 134/274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:03.593291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.594653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:03.600654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.601142 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.601576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.602276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.602794 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.603220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.618069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] HTTP exception thrown: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Request method failure captured: Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 HTTP/1.1 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKOSry1SYot8bpvjOQAGz4cinimulIZGNxQiIN1T-ReJOmK_ik-rmTpvpWwhFSZ7mmmf3uWULKKTRW1mkq7sg_YY-mVv2Yzgf1kuiBzVA3M-xGmQ-ayUtJFS9tz2TOoak0763PkBeEOETGuud5j9CB0mJU6sLcy_Vf0nKJ4QcnaBs Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:42:03.623320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 1d0ae308269b4cdd80990f7b38c0cd0c Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.624854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '8dc136a1-7d8f-4741-bb10-b8b908a9b386'} Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:03.625780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.629209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.630211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Returning 404 to user: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:03.630211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-00a24392-3f52-4f19-9fb6-7eb481324283 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 404 len: 111 microversion: 2.1 time: 0.035813 Aug 24 17:42:03.630211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 141/275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:03 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:03.687401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.688664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:03.699789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.700447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.700950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.701989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.702609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.703035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.770590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.773186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:03.780669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.781345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.781928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.782648 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.783099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.783519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.798501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] HTTP exception thrown: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Request method failure captured: Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386/os-volume_attachments HTTP/1.1 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKOSry1SYot8bpvjOQAGz4cinimulIZGNxQiIN1T-ReJOmK_ik-rmTpvpWwhFSZ7mmmf3uWULKKTRW1mkq7sg_YY-mVv2Yzgf1kuiBzVA3M-xGmQ-ayUtJFS9tz2TOoak0763PkBeEOETGuud5j9CB0mJU6sLcy_Vf0nKJ4QcnaBs Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:42:03.800399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 1d0ae308269b4cdd80990f7b38c0cd0c Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.801772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'server_id': '8dc136a1-7d8f-4741-bb10-b8b908a9b386'} Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:03.802425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:03.803461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:03.805030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Returning 404 to user: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:03.805030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9452d3b5-6dfc-459c-8dca-e9b62f65c347 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036108 Aug 24 17:42:03.805902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 142/276] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:42:03 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:03.913306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:03.939557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-94ef5436-ca9f-4ff7-9561-ce13ba1105bd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.257045 Aug 24 17:42:03.940537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 135/277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:03 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:04.960132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:04.960694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:04.966659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:04.967165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:04.967617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:04.968298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:04.968772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:04.969191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:05.105519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:05.113118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ba5d4ade-c6a8-43c1-aa02-8f66b777fd3a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.156960 Aug 24 17:42:05.113672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 143/278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:04 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:05.845829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1684539290", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:06.031859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] validate_networks() for None {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:06.134686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:06.136046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:06.142749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.143346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.143885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.144717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.145319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.145994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.150724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:06.372428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:06.372880 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:06.373353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:06.373761 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:06.374319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:06.376138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:06.383347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.383880 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.384406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.385822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.386439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.386868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.387519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6b5a75e4-87c6-4b5d-bc8a-0f6ebfb28cfd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.256756 Aug 24 17:42:06.388296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 144/279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:06 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:06.405148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Getting quotas for project 376329ca784b4fdea3205bf08edb45a8. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:06.409214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Getting quotas for user ccb4c2a7b74a479d890b73a0aae33bad and project 376329ca784b4fdea3205bf08edb45a8. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:06.420572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:06.422856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:06.466585 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a3977e49-65e0-40e9-a5fb-7938d8bd5b37 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624543 Aug 24 17:42:06.467222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 136/280] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:42:06.478079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-19120f50-829a-4e43-b8f8-3aa4eaa10d4f tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:06.478691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-19120f50-829a-4e43-b8f8-3aa4eaa10d4f tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:06.535924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-19120f50-829a-4e43-b8f8-3aa4eaa10d4f tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:06.542874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-19120f50-829a-4e43-b8f8-3aa4eaa10d4f tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1215 microversion: 2.1 time: 0.068747 Aug 24 17:42:06.552573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 145/281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:06 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:06.593023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2045120440", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "networks": [{"uuid": "c635252e-c85f-43d2-b877-3fdfccbbe408"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:06.644577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] validate_networks() for [('c635252e-c85f-43d2-b877-3fdfccbbe408', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:07.021876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:07.022521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:07.023060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:07.023671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:07.024319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:07.033956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.034741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.035245 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.036048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.036611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.037099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.053869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Getting quotas for project 8f5f06c64c9a459fa45ba85855d4324f. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:07.058293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Getting quotas for user 757f4cb8bb714ccc90b2f2589f9b2a1e and project 8f5f06c64c9a459fa45ba85855d4324f. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:07.069935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:07.072027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:07.120483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-45e6045b-7e9e-4b6a-a976-7b88eaece35a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531142 Aug 24 17:42:07.121165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 137/282] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:42:07.132188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-602d5158-1b72-4167-a3ed-330d99fcf305 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.132903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-602d5158-1b72-4167-a3ed-330d99fcf305 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.156254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.156772 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.163026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.163500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.163926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.164638 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.165089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.165666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.179807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] HTTP exception thrown: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Request method failure captured: Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: DELETE /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 HTTP/1.1 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKOSry1SYot8bpvjOQAGz4cinimulIZGNxQiIN1T-ReJOmK_ik-rmTpvpWwhFSZ7mmmf3uWULKKTRW1mkq7sg_YY-mVv2Yzgf1kuiBzVA3M-xGmQ-ayUtJFS9tz2TOoak0763PkBeEOETGuud5j9CB0mJU6sLcy_Vf0nKJ4QcnaBs Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:42:07.185346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 1d0ae308269b4cdd80990f7b38c0cd0c Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.186743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '8dc136a1-7d8f-4741-bb10-b8b908a9b386'} Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:07.187534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.188795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.190064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Returning 404 to user: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:07.190064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6e0cecc9-6679-4635-adc7-c3569442c958 tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 404 len: 111 microversion: 2.1 time: 0.036987 Aug 24 17:42:07.193177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-602d5158-1b72-4167-a3ed-330d99fcf305 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:07.194044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 138/283] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:42:07 2022] DELETE /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:07.201540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.202387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-602d5158-1b72-4167-a3ed-330d99fcf305 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1214 microversion: 2.1 time: 0.074114 Aug 24 17:42:07.203028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] [instance: 8dc136a1-7d8f-4741-bb10-b8b908a9b386] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.210168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.211079 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.211650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.213065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.213698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.214392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.216271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 146/284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:07 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:07.230717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] HTTP exception thrown: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Request method failure captured: Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 HTTP/1.1 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKOSry1SYot8bpvjOQAGz4cinimulIZGNxQiIN1T-ReJOmK_ik-rmTpvpWwhFSZ7mmmf3uWULKKTRW1mkq7sg_YY-mVv2Yzgf1kuiBzVA3M-xGmQ-ayUtJFS9tz2TOoak0763PkBeEOETGuud5j9CB0mJU6sLcy_Vf0nKJ4QcnaBs Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:42:07.232238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9206de8ce97b425cb5c675ec0a240d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 9206de8ce97b425cb5c675ec0a240d71 Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377056634 Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 1d0ae308269b4cdd80990f7b38c0cd0c Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-DeleteServersTestJSON-1377056634-project Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.233735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '8dc136a1-7d8f-4741-bb10-b8b908a9b386'} Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:07.234556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. Aug 24 17:42:07.235817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:07.236993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] Returning 404 to user: Instance 8dc136a1-7d8f-4741-bb10-b8b908a9b386 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:07.236993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-277ed386-f075-4c18-924b-2b175f4e41ca tempest-DeleteServersTestJSON-1377056634 tempest-DeleteServersTestJSON-1377056634-project] 10.222.0.45 "GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386" status: 404 len: 111 microversion: 2.1 time: 0.038714 Aug 24 17:42:07.236993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 139/285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:07 2022] GET /compute/v2.1/servers/8dc136a1-7d8f-4741-bb10-b8b908a9b386 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:07.409467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.410063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.415954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.416437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.417700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.418395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.418845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.419272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.564095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.564799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.571069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.571545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.571973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.572710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.573249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.573672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.666642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:07.674895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f95ea7e0-1980-4832-878e-323ee999bccb tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1267 microversion: 2.1 time: 0.114936 Aug 24 17:42:07.675466 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 140/286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:07 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:07.709919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:07.718562 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-48bd34ae-708a-45d0-9af6-55997690d0f8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.312937 Aug 24 17:42:07.719114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 147/287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:07 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:08.221836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:08.222529 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:08.228779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.229279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.229709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.230388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.230871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.231310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.314757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:08.322313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cba86cae-298a-4c88-ae28-f26bfe6b8060 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1218 microversion: 2.1 time: 0.104352 Aug 24 17:42:08.323458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 141/288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:08 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:08.695285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:08.695890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:08.702433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.702927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.703367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.704131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.704615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.705040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.739224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:08.739748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:08.746176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.746664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.747095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.747787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.748239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.748691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.772904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:08.781304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c6ab3b4e-3ab0-4541-b388-0978a4822c0c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1267 microversion: 2.1 time: 0.089881 Aug 24 17:42:08.781966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 148/289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:08 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:08.959696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:08.967549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c2912fe2-6f91-4b67-9d3d-cd1116b0a363 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.232203 Aug 24 17:42:08.968127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 142/290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:08 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:09.343661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:09.344270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:09.350437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.350926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.351362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.352069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.352519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.352971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.425358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:09.436866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-90e1fe70-2b0e-418f-aeab-910c31e9c00c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1218 microversion: 2.1 time: 0.097554 Aug 24 17:42:09.438930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 149/291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:09 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:09.811883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:09.813236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:09.820589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.821151 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.821783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.822664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.823256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.823717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.888008 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:09.895981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8193f4f9-80ae-4946-acae-6c65dd1dcf04 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1273 microversion: 2.1 time: 0.097362 Aug 24 17:42:09.896695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 143/292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:09 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:09.987735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:09.988352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:09.994302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.994788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.995282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.996490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:09.996992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:09.997474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.139404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:10.154113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-da33e54d-7b7e-47a7-8192-d7ad0ed9614f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.169259 Aug 24 17:42:10.155129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 150/293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:09 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:10.461164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.461696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:10.469265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.469834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.470311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.471180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.471713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.472232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.569515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:10.577665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e71f4a30-505e-46f3-bb79-c8f5a69e66f8 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1266 microversion: 2.1 time: 0.120396 Aug 24 17:42:10.578243 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 144/294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:10 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:10.918443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.919061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:10.925924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=49 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:10.929193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.929692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.930135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.935005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-636933187", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1534415720", "security_groups": [{"name": "tempest-secgroup-smoke-1199944032"}], "block_device_mapping_v2": [{"uuid": "60180b4c-f12c-44be-8beb-df94cedf203c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4271adb9-59ee-439b-8826-7fda036d50f7"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:10.937391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.937971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.938421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.082639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:11.096675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3ff6e4ee-3d65-4513-b36e-2e8b014447c7 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1273 microversion: 2.1 time: 0.181708 Aug 24 17:42:11.110019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 151/295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:10 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:11.174356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] validate_networks() for [('4271adb9-59ee-439b-8826-7fda036d50f7', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:11.176233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:11.178440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:11.190880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.191616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.192444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.193388 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.194247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.194828 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.899967 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:11.911623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-72d7ff79-f038-4c6d-b9a5-def6ecc5277a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1522 microversion: 2.1 time: 0.740165 Aug 24 17:42:11.913148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 152/296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:11 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:11.918658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:11.919411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:11.925451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.926281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.926842 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.927663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.928373 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.928960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.066905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:12.078336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dbcd7d5d-a474-4832-9a4a-743f7524cb47 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1272 microversion: 2.1 time: 0.163872 Aug 24 17:42:12.089879 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 153/297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:11 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:12.119484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:12.120217 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:12.128308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.128826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.129264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.136754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.137652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.138633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.455975 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:12.464882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0bf7c598-a178-4256-99ca-226291920ea5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.349400 Aug 24 17:42:12.465672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 154/298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:12 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:12.481183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8938978c-4262-4f85-8ce5-76d4e6779c97", "tag": "0b8871ce-fcd2-4913-a15c-d2dbb31e56b7"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:12.492654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.493340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.494044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.506541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] Creating event network-changed:0b8871ce-fcd2-4913-a15c-d2dbb31e56b7 for instance 8938978c-4262-4f85-8ce5-76d4e6779c97 on hv-cinder-83538 Aug 24 17:42:12.512537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-da30ac5e-b1af-467a-8302-08a6a0d6f557 req-8a5d0f8b-ed95-4b44-9c75-7d366922eda8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045490 Aug 24 17:42:12.513402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 155/299] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:12.829353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:12.829833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:12.830236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:12.830640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:12.831045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:12.839710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.840194 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.840660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.841567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.842173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.842786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.860217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:12.865028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for user af6710bfe62d4ba29dc48e2f7aba9ec5 and project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:12.936007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:12.937172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:12.944036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.947904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.949053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.949368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:12.950112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.950757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.951331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.951516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60180b4c-f12c-44be-8beb-df94cedf203c',volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:13.134407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-46af2df9-3bab-4d48-b595-0da10f34c76b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.203912 Aug 24 17:42:13.141984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 145/300] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:42:13.147044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:13.148793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:13.156117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.157214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.157692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.158400 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.158855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.159275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.337608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.353448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2b2b79f3-5f61-422e-aa8f-578211243c8e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1502 microversion: 2.1 time: 0.422176 Aug 24 17:42:13.365192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 156/301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:12 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:13.376481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b8c2c226-fb0a-42bd-9733-ce4693a50d7d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:13.376947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b8c2c226-fb0a-42bd-9733-ce4693a50d7d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:13.466605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b8c2c226-fb0a-42bd-9733-ce4693a50d7d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.474891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b8c2c226-fb0a-42bd-9733-ce4693a50d7d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1094 microversion: 2.1 time: 0.108558 Aug 24 17:42:13.486716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 157/302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:13 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:13.496031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.509647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:13.510305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:13.513880 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-26f182e8-1ac6-437b-aea5-fe3f9865864e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.369654 Aug 24 17:42:13.514779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 146/303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:13 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:13.520674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.520963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:13.521140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.521566 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.522258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.522663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:13.522788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.523175 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.530392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.531250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.531869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.532867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.534264 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.534853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.739236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.741897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.747325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f21fab5d-54da-4341-8cb7-522ab50278ef tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.231012 Aug 24 17:42:13.748376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 147/304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:13 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:13.751098 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4f645ae7-624c-4f57-910e-d78250aa164f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1515 microversion: 2.1 time: 0.256608 Aug 24 17:42:13.751788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 158/305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:13 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:14.500486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:14.501136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:14.507531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.508032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.508463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.509264 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.509713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.510126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.535546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:14.536838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:14.546598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.547086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.547518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.548368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.549029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.549450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.575982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:14.584117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-81c8b8cf-c5b9-47fa-aef3-efcc565c2646 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1144 microversion: 2.1 time: 0.087319 Aug 24 17:42:14.584690 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 148/306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:14 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:14.683726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:14.691658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-edfd5bc9-1339-4a8a-9bef-76e55f5a2f81 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.159824 Aug 24 17:42:14.692275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 159/307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:14 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:14.769581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:14.770196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:14.776660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.777156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.777588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.778286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.778741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.779167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.909879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:14.917704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-18ab1ffe-07b6-44e7-b622-cd0af77c1565 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.152260 Aug 24 17:42:14.918272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 149/308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:14 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:15.605474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:15.606085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:15.612672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.613164 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.613601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.614294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.614760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.615349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.694507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:15.702261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-08d7a3b8-1212-4576-bbde-016b299ca888 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1144 microversion: 2.1 time: 0.101258 Aug 24 17:42:15.703009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 160/309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:15 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:15.721686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:15.722500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:15.728864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.730061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.730551 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.731318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.731836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.732321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.932146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:15.938094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:15.938696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:15.940060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8869af7c-96e2-4654-9012-a7d3e01a9c97 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.222416 Aug 24 17:42:15.940722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 150/310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:15 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:15.944821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.945299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.945728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.946408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:15.947009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:15.947429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.091231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:16.098999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0b315e16-78c1-47f5-b816-ce6c538e95d3 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.164634 Aug 24 17:42:16.099501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 161/311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:15 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:16.191070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:16.193389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:16.199731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.200213 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.200750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.201445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.201896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.202323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.225118 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lazy-loading 'flavor' on Instance uuid 7040ce09-b5cc-4ec0-ae83-40302cb09bbd {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:16.286796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:16.337769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9df493b7-ca4b-468d-8241-64dc1e653a37 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/action" status: 200 len: 32 microversion: 2.1 time: 0.150530 Aug 24 17:42:16.338525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 151/312] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:42:16 2022] POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:42:16.348310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:16.349074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:16.355655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.356376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.357019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.357777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.358307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.358793 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.488804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:16.496985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e4d88449-d776-4fc8-9868-eab0625fb905 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.152444 Aug 24 17:42:16.497536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 162/313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:16 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:16.723861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:16.724657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:16.727057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:16.733409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.733892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.734329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.735023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.735485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.735911 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.806968 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:16.817084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-387fccdd-a2f5-4a09-b613-276f8213286f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1144 microversion: 2.1 time: 0.097538 Aug 24 17:42:16.817739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 152/314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:16 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:16.962073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:16.962762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:16.968942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.969447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.969875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.970564 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.971014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.971430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.124884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:17.125698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:17.143528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.144024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.144842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.145559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.146030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.149275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.282218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:17.294887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c9152e1a-373b-4801-8194-50ba99bc49ac tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.337863 Aug 24 17:42:17.295639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 163/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:16 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:17.518061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:17.518663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:17.524776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.525349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.525926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.526655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.527178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.527667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.546906 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:17.636912 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:17.644684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9ae3c6d7-85a3-4fdf-923e-63c32bf7c4ac tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.526151 Aug 24 17:42:17.645255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 153/316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:17 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:17.840119 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:17.842822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:17.849774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.850996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.851802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.853368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.854017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.854965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.064404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:18.072948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3f194b0d-e58b-4a66-ad1f-ef0da4a806e5 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1210 microversion: 2.1 time: 0.237700 Aug 24 17:42:18.073860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 154/317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:17 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:18.130241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:18.142718 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fc2c87bc-b0bf-47ad-b8ed-043f0df2614e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.625643 Aug 24 17:42:18.143898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 164/318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:17 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:18.320183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:18.321001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:18.333951 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.334672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.336767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.338364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.339594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.340397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.665824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:18.666422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:18.672394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.672905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.673336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.674011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.674459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.674877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.048958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:19.057946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-50275dcf-694a-4aa1-8d4a-9e18fa5e2f6c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.743675 Aug 24 17:42:19.058749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 155/319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:18 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:19.095073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:19.096516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:19.103236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.103720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.105017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.105943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.106400 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.106990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.221479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:19.230526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6c556cee-bc67-4ea4-b25c-cb8545f31712 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1198 microversion: 2.1 time: 0.139876 Aug 24 17:42:19.245658 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 156/320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:19 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1198 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:19.252277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:19.253782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:19.261434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.262862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.265573 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.266487 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.267161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.267742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.405919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:19.417643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a9ffba1a-e315-419c-bef7-9056a4a2e940 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.754971 Aug 24 17:42:19.418921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 165/321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:18 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:19.564651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:19.573570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9a5d480c-f668-43bd-abef-824ec71cbd49 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.326220 Aug 24 17:42:19.574137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 157/322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:19 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:19.644774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944df36b-7d5e-4837-a9e5-e33b16e7a744", "tag": "8ee01bc6-3ee3-485b-874f-ca017cb4ffa2"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:19.655377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.656236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.656706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.668516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] Creating event network-changed:8ee01bc6-3ee3-485b-874f-ca017cb4ffa2 for instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 on hv-cinder-83538 Aug 24 17:42:19.673851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-b3965c45-8f84-4491-9e1d-4e5a9c6971f0 req-3206ac55-9717-4117-9a6f-68d67ec08a0f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Aug 24 17:42:19.674597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 166/323] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:20.079550 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:20.080941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:20.090671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.091570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.092204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.093366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.094005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.094500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.247167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:20.255559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-20abc6bd-c416-4d05-aaba-83eebe61f6d2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.179893 Aug 24 17:42:20.256134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 158/324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:20 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:20.257980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:20.258905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:20.266333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.266810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.267234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.267923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.268363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.268984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.414037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:20.423217 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a47c11dc-a2b1-44cd-b582-4ced052cb518 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.172266 Aug 24 17:42:20.424068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 167/325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:20 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:20.439418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:20.440256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:20.447034 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.447510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.448704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.449556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.450347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.451076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.594872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:20.595394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:20.600669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:20.613729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cd556ef3-59ab-4ebf-815e-b23880d3a349 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.175860 Aug 24 17:42:20.614318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 159/326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:20 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:20.618495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.619209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.620379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.621367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.621965 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.622542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.887759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:20.896105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-efa574df-c768-4315-8672-7d827d9fb7ce tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.305267 Aug 24 17:42:20.896685 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 168/327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:20 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:21.276760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:21.277371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:21.283740 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.284216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.284681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.285368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.285818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.286239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.418860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:21.426435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-abaaf081-0826-45b3-b02c-a4fcd5e3191d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.153650 Aug 24 17:42:21.426991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 160/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:21 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:21.445335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:21.445972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:21.452661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.453141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.453738 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.454427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.454878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.455294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.584105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:21.592305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-73a13d2f-26b7-43dd-a159-c5e826eb662d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.150807 Aug 24 17:42:21.592896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 169/329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:21 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:21.634108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:21.634722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:21.641467 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.641941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.642379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.643067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.643526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.643954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.773424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:21.781490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-34295281-f0b5-491e-acc7-91f92c8205e5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.151181 Aug 24 17:42:21.781997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 161/330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:21 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:21.917593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:21.918189 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:21.924020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.924716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.925149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.925825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.926270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.926687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.050214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:22.058393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-75b42e04-957a-4285-bd1e-c076ecfc3e3c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.144636 Aug 24 17:42:22.058949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 170/331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:21 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:22.446663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.447271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.453719 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.454197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.454630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.455311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.455763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.456186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.585500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:22.593508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e704e5b4-d7ac-47a7-837e-378d6bca4183 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.150722 Aug 24 17:42:22.594069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 162/332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:22.612376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.613020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.619034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.619510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.620004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.620723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.621173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.621599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.802188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.802822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.808816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.809292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.809843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.810610 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.811054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.811473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.843599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:22.851408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7dc59538-a79f-433d-8c47-5cb1064e91a0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.242787 Aug 24 17:42:22.851597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:22.852468 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 171/333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:22.872494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=18 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:23.036154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:23.044116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0db5bf45-e6fd-4970-ab6c-0ac56e73736e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.246023 Aug 24 17:42:23.044707 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 163/334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:23.079526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:23.080132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:23.086012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.086484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.086909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.087586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.088028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.088602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.409821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:23.418238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f720ad58-a021-4c7e-b15e-996880192df0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.342475 Aug 24 17:42:23.418815 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 172/335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:23 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:23.615759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:23.616371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:23.623482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.624035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.624544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.625338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.625878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.626371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.871211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:23.871827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:23.873829 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=6 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:23.879290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.879779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.880206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.881129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.881586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.882006 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.040335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.048451 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-145e2c86-6d80-45ee-8988-5116094e9ed9 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.437102 Aug 24 17:42:24.049080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 164/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:23 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:24.053598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8938978c-4262-4f85-8ce5-76d4e6779c97", "name": "network-vif-plugged", "status": "completed", "tag": "0b8871ce-fcd2-4913-a15c-d2dbb31e56b7"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:24.064032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.064511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.064982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.076837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] Creating event network-vif-plugged:0b8871ce-fcd2-4913-a15c-d2dbb31e56b7 for instance 8938978c-4262-4f85-8ce5-76d4e6779c97 on hv-cinder-83538 Aug 24 17:42:24.082023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-53381e01-3077-45d8-b25f-d1ae5fea2880 req-6c7cfedf-4d5a-46dd-b9b5-33412d1bc13a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Aug 24 17:42:24.082700 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 165/337] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:24.090560 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:24.091253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:24.099585 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.100033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.100575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.101534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.101758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.102180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.420730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.428391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-aad3cb80-b13c-4c41-8d77-715208ffe682 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.561076 Aug 24 17:42:24.428980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 173/338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:23 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:24.435105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5b60a1-b2cb-4bbd-b257-0389ddd4018d", "tag": "97c9e402-e829-42c1-bfa7-cd80ccab0f40"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:24.443679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.444159 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.444661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.458837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] Creating event network-changed:97c9e402-e829-42c1-bfa7-cd80ccab0f40 for instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d on hv-cinder-83538 Aug 24 17:42:24.463840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a2cd84ad-4abb-4852-b35f-99e6834ee502 req-e4db5e54-5594-4cd4-8d45-a7f5cbe3fe24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033778 Aug 24 17:42:24.464467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 174/339] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:24.469456 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:24.470134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:24.476146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.476938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.477076 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.477735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.478177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.478595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.609119 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.617033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f42770c0-ced6-4526-a3da-76fae70ed348 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.530331 Aug 24 17:42:24.617673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 166/340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:24 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:24.669447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.676954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3db2e9e7-eac0-498c-9eb7-d9dd2c0e3f93 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.211360 Aug 24 17:42:24.677508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 175/341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:24 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.071731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.072345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.079604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.080090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.080523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.081248 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.081704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.082130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.370599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.374154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:25.379006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bcb4725b-f0ea-4ded-ad10-aebdebc60c04 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.311260 Aug 24 17:42:25.379569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 167/342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.450441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.451375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.457256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.457733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.458164 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.458851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.459299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.459712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.586259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.593902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-feb5b4f2-b0cf-43c7-a492-91dd07ebf2eb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.148003 Aug 24 17:42:25.594460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 176/343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.639499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.640111 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.646893 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.647379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.647816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.648503 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.648989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.649419 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.700743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.700743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.705488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.705968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.706402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.707095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.707551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.707974 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.825459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.836965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3bdf6bb0-150e-4892-b1a8-eb2c1342abd0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.201073 Aug 24 17:42:25.838110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 168/344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.905817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.913597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c71a879d-73e3-45b5-acbd-71fb47d330ae tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.219110 Aug 24 17:42:25.914159 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 177/345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:26.399721 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.400335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.407274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.407756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.408195 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.408923 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.409384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.409811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.544957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:26.552530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d15daedf-899f-49d4-bf5c-0b19dc63b0ec tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.156745 Aug 24 17:42:26.553128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 169/346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:26.614263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.614870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.620861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.621331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.621757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.622453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.622880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.623303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.750010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:26.757666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d7f82a05-abae-4106-8bb6-981f5c849119 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.147277 Aug 24 17:42:26.758206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 178/347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:26.857946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.858562 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.864498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.865040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.865480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.866161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.866614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.867042 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.935571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.936306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.942101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.942681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.942985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.943666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.944130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.944510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.025819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:27.033424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6d5f2f0b-3056-456c-ad18-444a21531da9 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.179473 Aug 24 17:42:27.033994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 170/348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:27.088130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:27.095721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-15352c03-b350-4e75-9c8b-5d08c42817de tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.164493 Aug 24 17:42:27.096276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 179/349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:27.573367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:27.574150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:27.580394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.580919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.581354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.582493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.583185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.583705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.716952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:27.724499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d0895b4-8759-4067-ae94-43e9331012b6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.155437 Aug 24 17:42:27.725089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 171/350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:27 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:27.778758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:27.779361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:27.785620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.786127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.786644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.787330 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.787811 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.788226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.923698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:27.931523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-caa0b4da-01ca-4edf-a893-431e45f334b6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.156731 Aug 24 17:42:27.932113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 180/351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:27 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:28.053155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:28.053757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:28.060159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.060659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.061090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.061830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.062288 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.062735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.116479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:28.117113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:28.123765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.124184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.124637 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.125324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.125812 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.126241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.241181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:28.250149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2b5a9005-73b8-4cfa-a0ad-0ad867431bd5 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.200699 Aug 24 17:42:28.255953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 172/352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:28 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:28.289439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:28.298181 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c3d0608d-8f21-424a-8b1d-a2fafba8334d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.185807 Aug 24 17:42:28.298792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 181/353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:28 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:28.745221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:28.745823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:28.751807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.752307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.752810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.753483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.753927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.754339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.912691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:28.914330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-86768847-d8f4-4a4c-9408-96de5664fabf tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.172947 Aug 24 17:42:28.915162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 173/354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:28 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:28.953705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:28.954300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:28.960633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.961259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.961815 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.962579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.963101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.964194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.985375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:29.122613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:29.130845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-afd2a76a-a738-4583-89ec-83c496ba2299 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.180972 Aug 24 17:42:29.131499 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 182/355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:28 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:29.277509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.278113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:29.284187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.284745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.285181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.285881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.286374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.286798 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.319345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.319991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:29.326649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.327413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.327902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.328642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.329089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.329516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.460900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:29.468513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bb282e12-edd7-449a-babc-125566d2d2d8 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1315 microversion: 2.1 time: 0.194823 Aug 24 17:42:29.469108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 174/356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:29 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:29.489619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:29.497724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cff32b8e-66d9-4133-94a2-0e7da8e21c35 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.182175 Aug 24 17:42:29.498283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 183/357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:29 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:29.937421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.938129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:29.945234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.945717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.946727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.947429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.948897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.949323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.087947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:30.095680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ad6bbe0a-4397-4e54-8754-e9ad8d23ef85 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.162242 Aug 24 17:42:30.096243 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 175/358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:29 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:30.154442 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.155059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.160965 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.161438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.161895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.163282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.164256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.164712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.398101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:30.405936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3f45ce02-e3dd-46ac-906f-b5450212507e tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.255496 Aug 24 17:42:30.406721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 184/359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:30 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:30.489558 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.490166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.497344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.498158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.498799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.499747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.500361 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.500806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.519260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.519948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.526594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.527737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.528653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.529494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.529998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.530560 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.709916 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:30.718054 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-afbfd2a6-0aeb-4417-897b-04ad1de4e057 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.203063 Aug 24 17:42:30.718624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 185/360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:30 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:30.736759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:30.744387 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-477e08a9-c4c6-46b1-836b-9adead8ee4a0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1464 microversion: 2.1 time: 0.259001 Aug 24 17:42:30.744982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 176/361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:30 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:30.789505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.790002 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.796575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.797075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.797507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.798270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.798728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.799186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.823622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:42:30.903248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c55e7b98-2bad-4a2b-b16f-425953b865dc tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 204 len: 0 microversion: 2.1 time: 0.117369 Aug 24 17:42:30.903825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 186/362] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:42:30 2022] DELETE /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:42:30.911842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.912448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.918851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.919335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.919764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.920448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.920993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.921418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.055959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:31.063891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-69f3c19d-5814-4c74-b46a-50859befdb79 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.155865 Aug 24 17:42:31.064444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 177/363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:30 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:31.116523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:31.117235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:31.123022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.123489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.123914 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.124616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.125063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.125476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.253675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:31.262111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f6cb5242-8bc1-4bb2-81e0-d181d9d5a855 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.149211 Aug 24 17:42:31.262686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 187/364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:31 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:31.428012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:31.428733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:31.435033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.435672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.436103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.436801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.437247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.437662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.594190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:31.601764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-472c4505-3bef-4f06-ba41-579c357e91d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.177640 Aug 24 17:42:31.602321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 178/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:31 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:31.739003 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:31.739613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:31.745590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.746551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.746984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.747679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:31.748128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:31.748545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:31.876817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:31.884479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-94ffdede-9661-41ac-9cb2-f74b332cf0bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.149261 Aug 24 17:42:31.885077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 188/366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:31 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:32.084891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:32.085428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:32.091711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.092197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.092663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.093357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.093813 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.094238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.222032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:32.229737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d1755c8-e44d-4435-aef3-9963fedce7c0 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.148758 Aug 24 17:42:32.230301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 179/367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:32 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:32.283321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:32.284020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:32.290154 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.290629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.291059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.291745 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.292191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.292639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.417069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:32.425248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c20e3b23-23d3-4301-9aae-a8f8c2ac9739 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.145851 Aug 24 17:42:32.425801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 189/368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:32 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:32.622127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:32.622778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:32.628542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.629049 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.629478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.630309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.630774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.631179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.759704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:32.768058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a0ce18ee-f1f7-4da8-a842-1308c0ccce88 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.149804 Aug 24 17:42:32.768642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 180/369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:32 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:32.906093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:32.906695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:32.912571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.913051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.913475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:32.914150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:32.914612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:32.915016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.041405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:33.048859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-239f399b-9a20-4e39-a322-4b87377b2859 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.147152 Aug 24 17:42:33.049419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 190/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:32 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:33.251904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:33.252472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:33.259117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.259591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.260026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.260744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.261198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.261621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.387706 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:33.395565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-96c2616f-31c1-4106-90ad-62872599dd5a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.147771 Aug 24 17:42:33.396129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 181/371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:33 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:33.445953 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:33.446556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:33.452899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.453367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.453791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.454491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.455084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.455448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.581715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:33.589203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3df65d0a-1fc8-4350-bc94-fac677e1a080 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.147126 Aug 24 17:42:33.589757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 191/372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:33 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:33.787865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:33.788504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:33.794330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.794809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.795238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.795919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:33.796362 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:33.796806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:33.925781 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:33.934045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-238ad746-7302-40f5-94fe-b3742cf64840 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.149430 Aug 24 17:42:33.934622 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 182/373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:33 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:34.070779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:34.071308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:34.077270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.077750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.078176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.078854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.079300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.079717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.204416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:34.212019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2037e4c7-3242-47ae-b4c9-cf8b1b154b3e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.145219 Aug 24 17:42:34.212598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 192/374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:34 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:34.416750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:34.417357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:34.424421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.424942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.425379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.426065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.426518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.426942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.555846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:34.563423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3641b9c4-efec-44fa-8411-24cdb433d263 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.150583 Aug 24 17:42:34.563991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 183/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:34 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:34.610697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:34.611304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:34.617626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.618147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.618579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.619290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.619738 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.620153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.746735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:34.754385 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-01c39f35-af34-4563-b516-f004b0c5c159 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.148272 Aug 24 17:42:34.754940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 193/376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:34 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:34.954804 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:34.955372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:34.961234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.961718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.962147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.962860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:34.963308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:34.963732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:34.981544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:35.093626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:35.101238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fb116375-dc45-432b-8e8c-a57cdd0d7d93 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.150796 Aug 24 17:42:35.101800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 184/377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:34 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:35.232642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:35.233234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:35.239079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.239551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.239977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.240679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.241126 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.241543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.367532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:35.375523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-df25f51a-9e91-4ea8-b801-dd3011768f6a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.146790 Aug 24 17:42:35.376075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 194/378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:35 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:35.583928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:35.584464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:35.590782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.591257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.591742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.592426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.592916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.593336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.720277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:35.728020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-071b4725-6c9d-4679-9000-3c179587727e tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.148041 Aug 24 17:42:35.728600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 185/379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:35 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:35.779086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:35.779666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:35.785483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.785956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.786383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.787056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:35.787501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:35.787914 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:35.922477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:35.930754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eb52abc1-9450-4749-af10-733f55f4096b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.155383 Aug 24 17:42:35.931583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 195/380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:35 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:36.121881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:36.122413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:36.128241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.128758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.129192 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.129881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.130329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.130750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.261632 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:36.270156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d79fdaed-d54c-40b8-80ea-8ea414e03c68 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.152263 Aug 24 17:42:36.270724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 186/381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:36 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:36.345541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944df36b-7d5e-4837-a9e5-e33b16e7a744", "name": "network-vif-plugged", "status": "completed", "tag": "8ee01bc6-3ee3-485b-874f-ca017cb4ffa2"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:36.354889 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.355365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.355787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.366978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] Creating event network-vif-plugged:8ee01bc6-3ee3-485b-874f-ca017cb4ffa2 for instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 on hv-cinder-83538 Aug 24 17:42:36.371659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-2674fad7-aff7-4991-87bc-e7007aea287f req-b86f8fcd-1e61-4757-80e6-7fd84973d92c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 Aug 24 17:42:36.372294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 196/382] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:36.397535 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:36.398157 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:36.404710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.405226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.405664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.406580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.407041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.407469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.539193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:36.546792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e59512ce-344b-431e-9ad6-0a944808eced tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.153406 Aug 24 17:42:36.547353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 187/383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:36 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:36.750650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:36.751342 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:36.753306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:36.759595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.760062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.760487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.761219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.761662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.762075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.906357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:36.913938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a5c248d3-27a5-46ec-a32b-7fee57f6629d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.168237 Aug 24 17:42:36.914821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 197/384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:36 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:36.952789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:36.953545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:36.960039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.960524 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.960985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:36.961672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:36.962130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:36.962556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.108499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:37.116475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-092a49f1-dd6a-4ae9-aae8-b6cb5b8e0c64 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.167992 Aug 24 17:42:37.117072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 188/385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:36 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:37.299397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:37.300072 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:37.312427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.313041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.313448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.314248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.314716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.315139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.319788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:37.451533 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:37.459132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b08dc3ee-eb4c-4c69-a4e4-4752d45658ad tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.171792 Aug 24 17:42:37.459699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 198/386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:37 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:37.566621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:37.567162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:37.573033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.573503 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.573928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.574599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.575046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.575463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.702452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:37.709933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6c88aafd-3443-438a-bc72-9f0fedd5afb7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.147210 Aug 24 17:42:37.710493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 189/387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:37 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:37.934918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:37.935532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:37.941527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.942009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.942439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:37.943125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:37.943579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:37.944000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.067336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:38.074849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-04a4cbe6-30b2-47e8-bda3-554497412b4a tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.143792 Aug 24 17:42:38.075426 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 199/388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:37 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:38.137241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:38.137881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:38.144922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.145406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.145838 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.146558 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.147009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.147430 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.297177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:38.305654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f3248641-f4e8-4987-999f-cd6f12642f5a tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.172199 Aug 24 17:42:38.306214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 190/389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:38 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:38.480645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:38.481392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:38.488003 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.488480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.488946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.489638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.490087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.490508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.620097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:38.628320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5c018b25-ac13-4381-94e4-bc1d2aa2e709 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.152379 Aug 24 17:42:38.628918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 200/390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:38 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:38.731199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:38.731764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:38.738163 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.738639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.739093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.739779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:38.740241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:38.740699 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:38.865352 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:38.872850 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-83407c07-eea0-4397-abc7-63153b9a98df tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.145553 Aug 24 17:42:38.873417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 191/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:38 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:39.096571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:39.097130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:39.103060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.103538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.103968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.104685 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.105137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.105555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.270192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:39.277907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e6bf2b80-174b-47e9-83e8-321f7246b01d tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.185844 Aug 24 17:42:39.278668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 201/392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:39 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:39.326802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:39.327989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:39.334488 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.334974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.335494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.336095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.336578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.337007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.492905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:39.501106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f3a7d1fe-156c-4d28-ae47-0e99f3dedf36 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.178088 Aug 24 17:42:39.501688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 192/393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:39 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:39.649204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:39.649847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:39.656133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.656659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.657098 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.658011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.658594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.658879 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.895662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:39.896811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:39.903581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.904057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.904483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.905220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:39.905664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:39.906257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:39.943162 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:39.953543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3efb5928-d1e8-44bb-8fff-c93f2869fa06 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.307767 Aug 24 17:42:39.954552 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 202/394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:39 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:40.041998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:40.050178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2cf7e019-6380-4b30-b3f1-5698660f5776 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.160302 Aug 24 17:42:40.050886 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 193/395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:39 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:40.299705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:40.300400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:40.306493 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.306976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.307401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.308082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.308526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.308960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.522420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:40.523199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:40.529707 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.530376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.531321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.532056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.532621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.533189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.556566 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:40.565645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9db7984a-4bbc-478a-9daf-eea706e6204c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1470 microversion: 2.1 time: 0.270180 Aug 24 17:42:40.566819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 203/396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:40 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:40.744287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:40.752856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5fc87c6a-22ac-4bab-9598-9ad165769ca1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.234720 Aug 24 17:42:40.754066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 194/397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:40 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:40.859857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8938978c-4262-4f85-8ce5-76d4e6779c97", "name": "network-vif-deleted", "tag": "0b8871ce-fcd2-4913-a15c-d2dbb31e56b7"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:40.870553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.871116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.871421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.886017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] Creating event network-vif-deleted:0b8871ce-fcd2-4913-a15c-d2dbb31e56b7 for instance 8938978c-4262-4f85-8ce5-76d4e6779c97 on hv-cinder-83538 Aug 24 17:42:40.891897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-9d3e5d0e-06c3-4403-bc20-1b6d1dd48e38 req-b389a256-d01b-48b8-b27e-ad6dea0d7631 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035551 Aug 24 17:42:40.892710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 204/398] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:40.974755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:40.975488 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:40.982123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.982799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.983392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:40.984300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:40.984926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:40.985496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.075048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:41.076583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:41.084305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.084926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.085368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.086065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.086524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.086950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.222591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:41.231083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c15a8058-4067-495d-80f3-0e23bfb8da53 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.260234 Aug 24 17:42:41.231652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 195/399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:40 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:41.323594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:41.331989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9e81cd37-a488-4b26-b45a-8639870636f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.261988 Aug 24 17:42:41.332576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 205/400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:41 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:41.589629 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:41.590190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:41.597322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.597945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.598385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.599081 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.599542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.600025 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.666575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:41.675377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ec958a77-552b-43cf-b867-efdb8e59c17c tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1300 microversion: 2.1 time: 0.089644 Aug 24 17:42:41.675941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 196/401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:41 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:41.775625 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:41.776300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:41.783191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.783804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.784293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.785081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:41.785587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:41.786069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:41.935866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:41.943944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-79727a5a-cfcf-4e5c-976c-0383dbb3267f tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1314 microversion: 2.1 time: 0.172614 Aug 24 17:42:41.944519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 206/402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:41 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:42.254410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:42.256055 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.265935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.266733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.267252 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.268063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.268706 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.269440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.354477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:42.355860 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.362421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.362989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.363334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.364221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.364866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.365292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.522578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:42.530372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-67feb2c4-33af-4827-8f4e-2156ee6be16f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.282677 Aug 24 17:42:42.531525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 197/403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:42 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:42.611845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:42.622025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0857bbb5-f61c-42b6-b365-a5e5136905f6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1501 microversion: 2.1 time: 0.272897 Aug 24 17:42:42.628246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 207/404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:42 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:42.644198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d701796-bd7c-4ce1-a69a-6e1366292186"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:42.646756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.655748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.656856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.657434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.658289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.658825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.659330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.685578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] HTTP exception thrown: Cannot 'attach_volume' instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd while it is in vm_state rescued Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Request method failure captured: Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/os-volume_attachments HTTP/1.1 Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 74 Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKGZjtfUpqk-I7aBsLTwDoow31TFim1_lz_4bdzqcWhTXy8IslHKy-qrYaakTx9seATpW6aRGs0IqddNfLJmckT8DvuQw8Pl-pf6jx-z2nTsatY6zHjKdjMYdNMpjQfKQCzZ5E7_-Pm_zkWoY-Aoy1rKwiN-5C1VuhglFkWlZe95Bo Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:42:42.688232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 40c0367417434c04948e9f2a03e880a9 Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {"volumeAttachment": {"volumeId": "8d701796-bd7c-4ce1-a69a-6e1366292186"}} Aug 24 17:42:42.690110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Cannot 'attach_volume' instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd while it is in vm_state rescued Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'server_id': '7040ce09-b5cc-4ec0-ae83-40302cb09bbd', 'body': {'volumeAttachment': {'volumeId': '8d701796-bd7c-4ce1-a69a-6e1366292186'}}} Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:42.690872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd while it is in vm_state rescued Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:42.693013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd while it is in vm_state rescued Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Returning 409 to user: Cannot 'attach_volume' instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd while it is in vm_state rescued {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d6095eb-baff-4cb5-9267-6999a178934e tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050569 Aug 24 17:42:42.694983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 198/405] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:42:42 2022] POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:42:42.698119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:42.698810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.709525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:42.711448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.712135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.712850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.713822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.714557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.716542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.720718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.729821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.730320 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.731012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.732520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.733080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.733608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.769627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.771136 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.778454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.783186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lazy-loading 'fault' on Instance uuid 8938978c-4262-4f85-8ce5-76d4e6779c97 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:42.851721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:42.861927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-76477340-4526-476d-a92e-ec9da5177604 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1305 microversion: 2.1 time: 0.168786 Aug 24 17:42:42.862807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 208/406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:42 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:42.869328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7fe2976d-0b35-4fc3-a855-d0458e61d9e6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.166568 Aug 24 17:42:42.872601 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 199/407] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:42:42 2022] POST /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:42:42.878792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:42.879400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.885713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.886288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.886878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.887749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.888221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.888914 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.965723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:42.965978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:42.972446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.972964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.973401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:42.974321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:42.974817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:42.975320 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.000096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:43.064807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:43.072473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ddbe78f8-d101-42ce-a3c6-2070f7406498 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.198118 Aug 24 17:42:43.073294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 209/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:42 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:43.133544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:43.142129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d4b324a7-dcd0-47a1-b2f5-09267500ce44 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1498 microversion: 2.1 time: 0.181188 Aug 24 17:42:43.142868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 200/409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:42 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:43.552977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:43.553594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:43.562699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.563180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.563615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.564300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.564779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.565207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.611367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:43.611951 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:43.618056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.618543 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.618982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.619679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.620138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.620583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.647666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:42:43.712005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:43.719966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8cb60d61-4c4a-4820-ac7d-3c1c7d29b05f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.170765 Aug 24 17:42:43.720826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 210/410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:43 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:43.725940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:43.741553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-df780d98-391a-4694-93e8-8213f72fd1b4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "DELETE /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 204 len: 0 microversion: 2.1 time: 0.134064 Aug 24 17:42:43.742363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 201/411] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:42:43 2022] DELETE /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:42:43.751927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:43.752694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:43.758768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.759245 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.759669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.760379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.760862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.761277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.889574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:43.891189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:43.894832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:43.899686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.900223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.900763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.901635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.902230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.903033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.905059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-54eaa797-c9fb-4f4a-be39-aa1a0de43243 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1504 microversion: 2.1 time: 0.158219 Aug 24 17:42:43.905659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 211/412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:43 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:43.947903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:43.948643 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:43.949241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:43.949692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lazy-loading 'fault' on Instance uuid 8938978c-4262-4f85-8ce5-76d4e6779c97 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:44.005337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb4c2a7b74a479d890b73a0aae33bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376329ca784b4fdea3205bf08edb45a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:44.014246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-51ef20de-e695-4603-a326-5b122663c809 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 200 len: 1305 microversion: 2.1 time: 0.134431 Aug 24 17:42:44.014969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 202/413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:43 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:44.097211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:44.098000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:44.104402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.105093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.105679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.106624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.107221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.107802 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.246482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:44.255886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-55d630ee-bd1c-4b2b-856c-0ab812a0bb64 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.162992 Aug 24 17:42:44.261485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 212/414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:44 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:44.741526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:44.742135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:44.749798 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.750292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.750723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.751763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.752655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.753083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.927303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:44.927915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:44.933862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.934338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.934769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.935485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.935931 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.936352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.957717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:44.965600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ae410f64-4d5d-4c4e-b517-71bf81f5e1f1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.228277 Aug 24 17:42:44.966089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 203/415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:44 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:45.045362 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:45.045969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] [instance: 8938978c-4262-4f85-8ce5-76d4e6779c97] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:45.051954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.052663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.053097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.053822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.054272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.054693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.069344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] HTTP exception thrown: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Request method failure captured: Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 HTTP/1.1 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmLrQdulgaZHK5dXQoJfn7Ov_rEBHGc89GHlAQJ95-XmXqLCgPC7Ah3VEGlvbGUQCNZBGt9aGAygxERZcvSgjBzzDtb-H3Y2ZnF-lmG4MqPQpDRDjD9Sq2W2yGWjmHgH3Mg4gYSAEHnOKy1EiTOKYICNmGp9IpX9UvI5GiMd_2SQf6E Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 376329ca784b4fdea3205bf08edb45a8 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesNegativeTest-1293895399 Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:42:45.070999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/376329ca784b4fdea3205bf08edb45a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/376329ca784b4fdea3205bf08edb45a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_376329ca784b4fdea3205bf08edb45a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/376329ca784b4fdea3205bf08edb45a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesNegativeTest-1293895399 Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 376329ca784b4fdea3205bf08edb45a8 Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesNegativeTest-1293895399 Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesNegativeTest-1293895399-project Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: ccb4c2a7b74a479d890b73a0aae33bad Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesNegativeTest-1293895399-project Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. Aug 24 17:42:45.072480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '8938978c-4262-4f85-8ce5-76d4e6779c97'} Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:45.073273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. Aug 24 17:42:45.074393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:42:45.075420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] Returning 404 to user: Instance 8938978c-4262-4f85-8ce5-76d4e6779c97 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:45.075420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8d7fb973-6a0b-4187-bff8-0a46c2ffe569 tempest-VolumesNegativeTest-1293895399 tempest-VolumesNegativeTest-1293895399-project] 10.222.0.45 "GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97" status: 404 len: 111 microversion: 2.1 time: 0.030909 Aug 24 17:42:45.075420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 204/416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1/servers/8938978c-4262-4f85-8ce5-76d4e6779c97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:42:45.182487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:45.194396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-51f6b9c0-8ca6-4275-83eb-914535536105 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1504 microversion: 2.1 time: 0.270886 Aug 24 17:42:45.195369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 213/417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:44 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:45.278508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:45.279376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:45.286068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.286625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.287190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.287985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.288449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.288903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.467208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:45.476721 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-034e333c-28e6-4075-b3ab-da9bbf0cdb7c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.202779 Aug 24 17:42:45.477542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 205/418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:45.986120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:45.986734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:45.993226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.993698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.994335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.995024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.995463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.996068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.218801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:46.220053 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:46.225392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:46.236291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.237181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.237902 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.238782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fa6000d7-28c3-4db0-acdc-8b9efb50a692 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.256229 Aug 24 17:42:46.238991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.239689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 214/419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:46.252635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.252635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.500193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:46.501399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:46.513787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.514317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.515047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.516777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.519536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.520270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.526106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:46.727093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:46.736531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e10c7898-2c14-4fb9-9917-e8b74b6d396c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1504 microversion: 2.1 time: 0.523282 Aug 24 17:42:46.737410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 206/420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:46 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:46.855570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:46.864850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b8d7c031-b60b-4ad8-81fd-c88fd208323d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.369961 Aug 24 17:42:46.872957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 215/421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:46 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:47.176984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944df36b-7d5e-4837-a9e5-e33b16e7a744", "name": "network-vif-deleted", "tag": "8ee01bc6-3ee3-485b-874f-ca017cb4ffa2"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:47.190190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.191036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.191763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.204016 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] Creating event network-vif-deleted:8ee01bc6-3ee3-485b-874f-ca017cb4ffa2 for instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 on hv-cinder-83538 Aug 24 17:42:47.209375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-3ef3fb9b-1f46-4785-9187-87c88c165f31 req-a2330d1f-9939-4f9a-bb5d-2bbef51f0450 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036233 Aug 24 17:42:47.210300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 207/422] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:47.259678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.261034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:47.271002 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.272581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.273305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.274234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.274894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.275413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.484317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:47.496822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5741036a-05d0-4b86-949e-eca2452eb126 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.241322 Aug 24 17:42:47.497704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 216/423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:47.759724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.760427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:47.767981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.768687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.769405 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.770729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.771306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.771875 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.848479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:47.856870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a125ffcf-d3de-4d6a-b343-3fcbae9eea29 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1462 microversion: 2.1 time: 0.101627 Aug 24 17:42:47.857660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 208/424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:47.894506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.895361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:47.901818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.902294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.902721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.903412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.903857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.904276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.051196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:48.059347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dcccab41-be41-42de-b3b9-8a4b62462e6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.169524 Aug 24 17:42:48.059918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 217/425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:48.517292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:48.518064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:48.526088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.526608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.527031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.528118 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.528757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.529263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.687644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:48.700034 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-371167a6-eafe-4ee4-b14f-d90cc0c54fed tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.186810 Aug 24 17:42:48.700994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 209/426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:48 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:48.879332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:48.880638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:48.887056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.887740 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.888325 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.889200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.889822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.890980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.911265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5b60a1-b2cb-4bbd-b257-0389ddd4018d", "name": "network-vif-plugged", "status": "completed", "tag": "97c9e402-e829-42c1-bfa7-cd80ccab0f40"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:48.941997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.942478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.942908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.977123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] Creating event network-vif-plugged:97c9e402-e829-42c1-bfa7-cd80ccab0f40 for instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d on hv-cinder-83538 Aug 24 17:42:48.984509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-a4f0227c-6496-4003-8307-9ebd4d446f98 req-f19731a0-8284-4bcf-8296-fd01f3f803a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076612 Aug 24 17:42:48.985226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 210/427] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:42:48.995678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:49.005165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d41fbb47-d079-4b91-ae95-3d58583d44a1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1462 microversion: 2.1 time: 0.129898 Aug 24 17:42:49.005949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 218/428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:48 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1462 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:49.082669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.082913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:49.092031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.092762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.093690 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:49.094792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.095559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.096235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:49.267598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:49.277908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ba1d2217-196b-464b-9b55-5931de929bcf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1509 microversion: 2.1 time: 0.198405 Aug 24 17:42:49.280173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 211/429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:49.721035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.721755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:49.727801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.728355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.728912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:49.729672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.730275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.730962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:49.878133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:49.885867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ecea1879-2462-49be-ae42-ff050902f0cc tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.169362 Aug 24 17:42:49.886445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 219/430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:50.027810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:50.028420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:50.035486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.036153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.036606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.037336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.037785 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.038207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.069083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.069566 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.070001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.073422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lazy-loading 'fault' on Instance uuid 944df36b-7d5e-4837-a9e5-e33b16e7a744 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:50.120347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:50.128888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-af57d642-26cf-4ddf-a364-b5aa455b3d92 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 200 len: 1304 microversion: 2.1 time: 0.105295 Aug 24 17:42:50.129386 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 212/431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:50 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:50.299277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:50.299897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:50.305823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.306297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.306723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.307397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.307840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.308259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.444639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:50.453314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a555ba90-3e75-4d2a-be58-267681d9bf28 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1515 microversion: 2.1 time: 0.157232 Aug 24 17:42:50.453891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 220/432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:50 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:50.909339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:50.910035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:50.916338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.916868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.917496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.918363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:50.918978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:50.919406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.123820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:51.136122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-294ab274-01b4-4041-950f-f3bdb58f0db1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1266 microversion: 2.1 time: 0.231782 Aug 24 17:42:51.148681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 213/433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:50 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:51.150418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.151040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: 944df36b-7d5e-4837-a9e5-e33b16e7a744] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:51.157621 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.158353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.158791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.159509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.159961 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.160398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.174933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] HTTP exception thrown: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Request method failure captured: Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 HTTP/1.1 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmLs6s75PFiID0YhUzT_P1X8_xT_6iaKKQ-ntw0Me3MtxOV9IVdrWC_ivpPt9X-wopdKf_48IqhAFFUI6W_7WuZjtir0y5Q73SeLxkolnWsSu-dzpqGD12b2PCiFDsK8hDt2aNYDvwyA9r0r6PTCxwml6tm67B5Z4yOrzCWxTKFmX74 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 8f5f06c64c9a459fa45ba85855d4324f Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-VolumesActionsTest-1437805553 Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:42:51.176613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-VolumesActionsTest-1437805553 Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 8f5f06c64c9a459fa45ba85855d4324f Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-VolumesActionsTest-1437805553 Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-VolumesActionsTest-1437805553-project Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 757f4cb8bb714ccc90b2f2589f9b2a1e Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-VolumesActionsTest-1437805553-project Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. Aug 24 17:42:51.178081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '944df36b-7d5e-4837-a9e5-e33b16e7a744'} Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:51.178895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. Aug 24 17:42:51.180194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.181371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Returning 404 to user: Instance 944df36b-7d5e-4837-a9e5-e33b16e7a744 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:51.181371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1b1d5d90-1492-4458-99ed-e281e2206179 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 24 17:42:51.182806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 221/434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/servers/944df36b-7d5e-4837-a9e5-e33b16e7a744 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:51.292760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1360019832", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "networks": [{"uuid": "c635252e-c85f-43d2-b877-3fdfccbbe408"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:51.349985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] validate_networks() for [('c635252e-c85f-43d2-b877-3fdfccbbe408', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:51.736576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:51.737029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:51.737530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:51.737936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:51.738344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:51.746987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.747468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.747901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.748657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.749116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.750150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.768855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Getting quotas for project 8f5f06c64c9a459fa45ba85855d4324f. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:51.772854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Getting quotas for user 757f4cb8bb714ccc90b2f2589f9b2a1e and project 8f5f06c64c9a459fa45ba85855d4324f. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:51.783743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:51.786136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:51.831787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-912adb32-459f-484a-9710-39a760657640 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542649 Aug 24 17:42:51.832710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 214/435] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:42:51.843361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cc17ef91-df5c-4653-9256-3d6b0817c08e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.843979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cc17ef91-df5c-4653-9256-3d6b0817c08e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:51.913070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cc17ef91-df5c-4653-9256-3d6b0817c08e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:51.921508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2581bc8c-7c8c-4795-b09b-1a486467cd9a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: .version_select at 0x7fa666d91dc0>, body: {"keypair": {"name": "tempest-keypair-211940297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8JUj36GAOWztErS2a/DQTaXRypG/Osr8Tycen2u4sHZ86mw+7leefU8zJ/oY/ot7bxsL4xOyGFOskoTJ+wXf3080TAUK+Rk5jgIwrrLV1OWLHw6QPgh2WJyPdWjv0dsw=="}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:51.926196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cc17ef91-df5c-4653-9256-3d6b0817c08e tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1214 microversion: 2.1 time: 0.086704 Aug 24 17:42:51.927456 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 222/436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:51.943109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-2581bc8c-7c8c-4795-b09b-1a486467cd9a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for project c6986df7cf5d4be09aac96f460903bcc. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:51.947169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-2581bc8c-7c8c-4795-b09b-1a486467cd9a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for user 40c0367417434c04948e9f2a03e880a9 and project c6986df7cf5d4be09aac96f460903bcc. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:51.987851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2581bc8c-7c8c-4795-b09b-1a486467cd9a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069970 Aug 24 17:42:51.994678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 215/437] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:42:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:42:52.157789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:52.165613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:52.178347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.178829 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.179662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.180518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.181226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.181700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.400310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:52.408982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0cd8028c-df26-4b8f-a90d-8b7e63774110 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1453 microversion: 2.1 time: 0.256196 Aug 24 17:42:52.409823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 223/438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:52 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:52.433519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:52.435071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:52.443830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.445115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.446421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.448118 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.448688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.449708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.627796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:52.636705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-10c58b60-841a-405b-a32b-f6bca5be3453 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1453 microversion: 2.1 time: 0.207466 Aug 24 17:42:52.637275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 216/439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:52 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:52.950734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:52.951404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:52.965085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.966118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.966764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.967871 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.969379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.970018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:53.093170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:53.103190 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9d58e015-369d-4e3a-94ee-a9007a26471b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1284 microversion: 2.1 time: 0.158481 Aug 24 17:42:53.112727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 224/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:52 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:53.592793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-331361656", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d55932dd-2dc8-4d13-9500-87780006215c"}], "security_groups": [{"name": "tempest-securitygroup--226476271"}], "key_name": "tempest-keypair-211940297", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:53.855928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] validate_networks() for [('d55932dd-2dc8-4d13-9500-87780006215c', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:54.123475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:54.124606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:54.133135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.134453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.135494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.136235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.136716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.137470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.283275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:54.295851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a9c6634f-f8f5-4828-a31b-834644bf6399 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1272 microversion: 2.1 time: 0.176057 Aug 24 17:42:54.296492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 225/441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:54 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:54.890932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:54.891390 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:54.892060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:54.892475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:54.892921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:54.901993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.902477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.902914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.903635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.904096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.904522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.921740 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:54.926475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Getting quotas for user 40c0367417434c04948e9f2a03e880a9 and project c6986df7cf5d4be09aac96f460903bcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:54.938094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:54.940249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:54.994531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c3e1d237-3e97-46b5-add5-7099e3893e3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.405942 Aug 24 17:42:54.995804 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 217/442] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:42:55.007292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9b44688e-c738-49b9-9e26-9caded266a3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:55.007905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9b44688e-c738-49b9-9e26-9caded266a3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:55.102667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9b44688e-c738-49b9-9e26-9caded266a3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:55.110849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9b44688e-c738-49b9-9e26-9caded266a3f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1244 microversion: 2.1 time: 0.107191 Aug 24 17:42:55.111414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 226/443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:55 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:55.317567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:55.319153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:55.326309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:55.326990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:55.327636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:55.328331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:55.328817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:55.329235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:55.724433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:55.732816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b598cea8-9da8-4cde-b80a-ddb2c916254b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.419422 Aug 24 17:42:55.733998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 218/444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:55 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:56.131622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:56.132674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:56.139559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.140862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.141270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.142308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.142834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.143332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.407130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:56.415041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7f035b75-c7ec-462a-9d5f-14cef9126b92 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1302 microversion: 2.1 time: 0.287288 Aug 24 17:42:56.415609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 227/445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:56 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:56.582306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a2e02b-ba26-4daa-b9e7-a807115a468a", "tag": "97b815a3-6afd-4aec-b2cb-6dd80750c19a"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:56.592658 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.593394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.593990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.598067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:56.611959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] Creating event network-changed:97b815a3-6afd-4aec-b2cb-6dd80750c19a for instance f5a2e02b-ba26-4daa-b9e7-a807115a468a on hv-cinder-83538 Aug 24 17:42:56.617137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-9860f159-209e-4ae9-b297-d310fca1110a req-c7d5732a-59f9-4230-9d95-b5d61869704c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038763 Aug 24 17:42:56.617842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 219/446] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:56.754476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:56.755187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:56.760999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.761479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.761936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.762622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.763071 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.763488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:57.080457 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:57.088701 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5063caa1-233f-4d87-ba62-21506911dc16 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.338085 Aug 24 17:42:57.100634 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 228/447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:56 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:57.435821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:57.437633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:57.443660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:57.444138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:57.444578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:57.445279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:57.445726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:57.446147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:57.536944 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:57.545475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-61bdc960-7961-4e91-bdc4-898354464971 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1302 microversion: 2.1 time: 0.113943 Aug 24 17:42:57.546800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 220/448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:57 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:58.108963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:58.109569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:58.115423 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:58.115896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:58.116314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:58.117024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:58.117469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:58.117882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:58.251348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:58.259386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-76ccc299-199b-4308-a5e1-dcac47d0c88b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.154151 Aug 24 17:42:58.259960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 229/449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:58 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:58.566855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:58.567459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:58.573388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:58.573861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:58.574290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:58.574967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:58.575455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:58.575874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:58.672973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5b60a1-b2cb-4bbd-b257-0389ddd4018d", "tag": "97c9e402-e829-42c1-bfa7-cd80ccab0f40"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:58.682281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:58.682840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:58.683367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:58.694835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] Creating event network-changed:97c9e402-e829-42c1-bfa7-cd80ccab0f40 for instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d on hv-cinder-83538 Aug 24 17:42:58.700055 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-d1d96128-61e3-46dd-82af-4a6aa4818bc7 req-a7ed520c-dd6f-48c1-a369-0747734e0641 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Aug 24 17:42:58.700828 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 230/450] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:42:58.714580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:58.722090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1698e6e9-1451-4c23-a48a-dbf9e82a9412 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.159257 Aug 24 17:42:58.722642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 221/451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:58 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:59.282861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:59.283552 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:59.289656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:59.290136 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:59.290565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:59.291246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:59.291694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:59.292112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:59.422667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:59.429926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b9dcd670-4af5-4d17-8aed-0d9d418758e2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.151754 Aug 24 17:42:59.430484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 231/452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:59 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:59.743069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:59.743675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:59.750651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:59.751694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:59.751694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:59.752271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:59.752759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:59.753176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:59.955966 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:59.966062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-53954eac-88a6-4f92-ab8d-d90fda49eab8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.226644 Aug 24 17:42:59.966720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 222/453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:59 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:00.450408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:00.451109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:00.457614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:00.458088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:00.458512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:00.459190 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:00.459639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:00.460080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:00.589604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:00.598464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5b0b7685-b181-4d8b-bc9f-9ca9fc86b935 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.151859 Aug 24 17:43:00.599082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 232/454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:00 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:00.987706 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:00.988321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:00.994825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:00.995354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:00.995865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:00.996593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:00.997052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:00.997480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:01.168346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:01.176120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1679aecb-34f6-4e1d-902e-e2a10dbabd6d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.192809 Aug 24 17:43:01.176711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 223/455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:00 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:01.619696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:01.620312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:01.627328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:01.627810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:01.628242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:01.628964 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:01.629404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:01.629824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:02.103736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:02.112222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-16102360-ff1e-4080-b11e-7633462932e6 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.496682 Aug 24 17:43:02.120681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 233/456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:01 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:02.197449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:02.198226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:02.207212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:02.207813 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:02.208322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:02.209140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:02.209672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:02.210169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:02.746301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:02.754131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6c386894-51fa-4782-b101-bb160fcaf230 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.560558 Aug 24 17:43:02.754702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 224/457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:02 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:03.122301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:03.135959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:03.136590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:03.141120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.144919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.145358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.152596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.153090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.153529 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.154225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.154682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.155116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.166494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] Creating event network-changed:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:43:03.176018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-ec73c9ac-e5ed-4cf9-9ace-d68ebac2d39e req-cadb2640-da41-4557-a93d-2fedd13c02ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057011 Aug 24 17:43:03.177009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 234/458] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:43:03.342551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a2e02b-ba26-4daa-b9e7-a807115a468a", "name": "network-vif-plugged", "status": "completed", "tag": "97b815a3-6afd-4aec-b2cb-6dd80750c19a"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:03.354851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.355462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.356109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.370299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] Creating event network-vif-plugged:97b815a3-6afd-4aec-b2cb-6dd80750c19a for instance f5a2e02b-ba26-4daa-b9e7-a807115a468a on hv-cinder-83538 Aug 24 17:43:03.376380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-cba3da61-0f9d-4da0-8ada-59a3a4a229a5 req-76d339b1-6b04-4db5-a10c-c9c6be664203 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Aug 24 17:43:03.377579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 235/459] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:43:03.380956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:03.389809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-69270896-5815-4688-b5b6-482c2e48af08 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.257728 Aug 24 17:43:03.390380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 225/460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:03 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:03.776751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:03.777457 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:03.784032 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.784497 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.785028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.785757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:03.786203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:03.786615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:03.804466 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:03.913614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:03.922000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-13bd8c75-5a60-400d-ae70-89d16281d6f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.149389 Aug 24 17:43:03.922567 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 236/461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:03 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:04.411076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.411689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:04.418058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:04.418533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:04.418967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:04.419653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:04.420103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:04.420524 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:04.550336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:04.557883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7be20dc8-91aa-4831-952a-235604bdd867 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.150648 Aug 24 17:43:04.558453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 226/462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:04 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:04.942443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.943044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:04.949029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:04.949503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:04.949936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:04.950623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:04.951091 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:04.951490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:05.075884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:05.083474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b62c57b1-d08d-41bf-b66d-ddc7953145a0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.144936 Aug 24 17:43:05.084029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 237/463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:04 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:05.579505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:05.580051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:05.582036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:05.582688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=16 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:05.584032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:05.590995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:05.591472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:05.591905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:05.592617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:05.593072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:05.594061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:05.722419 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:05.730146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-29be8ccd-7fab-41f7-90ac-40625d2bbbed tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.155122 Aug 24 17:43:05.730844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 227/464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:05 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:06.104751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:06.105352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:06.107127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:06.112300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:06.112952 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:06.113378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:06.114053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:06.114496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:06.114909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:06.243634 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:06.251692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3a433daf-f085-470e-bc03-928a1d301d34 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.150831 Aug 24 17:43:06.252257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 238/465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:06 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:06.751231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:06.751878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:06.758228 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:06.758714 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:06.759149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:06.759846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:06.760304 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:06.760789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:06.887431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:06.895284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e092aac7-2922-4fb5-8eb8-850505e2c044 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.147965 Aug 24 17:43:06.895843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 228/466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:06 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:07.274526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:07.275137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:07.276995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=90 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:07.282953 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:07.283431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:07.283866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:07.284573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:07.285026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:07.285446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:07.413289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:07.421040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d0743e92-61cb-40e1-bf5e-745bf072eed7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.150571 Aug 24 17:43:07.421607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 239/467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:07 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:07.915089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:07.915696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:07.922595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:07.923073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:07.923501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:07.924215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:07.924707 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:07.925140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:08.050800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:08.058260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9695b7f1-bde1-4859-a733-d93b2757eca4 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.147033 Aug 24 17:43:08.058812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 229/468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:07 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:08.442446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:08.443057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:08.449028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:08.449506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:08.449938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:08.450620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:08.451070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:08.451490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:08.578675 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:08.586276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b9e98c7c-5f80-43b6-b963-33622ade1cc2 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.147757 Aug 24 17:43:08.586837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 240/469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:08 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:09.079976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:09.080540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:09.086971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:09.087452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:09.087886 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:09.088597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:09.089053 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:09.089519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:09.218447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:09.228066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-14513eef-6e46-4daa-ad78-505f5de7f2ea tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.152639 Aug 24 17:43:09.228647 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 230/470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:09 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:09.606882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:09.607494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:09.614081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:09.614561 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:09.614998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:09.615682 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:09.616134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:09.616573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:09.744198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:09.751759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b13bd445-d24e-4d36-81be-098b36bad531 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.148745 Aug 24 17:43:09.752319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 241/471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:09 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:10.253282 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:10.253896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:10.260356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:10.260879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:10.261319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:10.262009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:10.262472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:10.262898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:10.391458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:10.399297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7a8c0a92-5cd7-4ad0-9964-f119177f665d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.149890 Aug 24 17:43:10.399862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 231/472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:10 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:10.772244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:10.772907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:10.778915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:10.779394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:10.779826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:10.780507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:10.780986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:10.781405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:10.908329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:10.915727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e8406fd1-90d1-4900-8053-3ad56071e3d9 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.147361 Aug 24 17:43:10.916285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 242/473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:10 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:11.419788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:11.420398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:11.427397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:11.427879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:11.428311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:11.429031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:11.429491 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:11.429912 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:11.558120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:11.565683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ebcaf1db-1eac-40bc-85f9-0d06c848ab15 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.149818 Aug 24 17:43:11.566238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 232/474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:11 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:11.937035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:11.938075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:11.944020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:11.944502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:11.945052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:11.945746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:11.946195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:11.946615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:12.077314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:12.085561 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-91704b88-5f99-40ae-92e0-89d2a8d5f41a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.152535 Aug 24 17:43:12.086112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 243/475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:11 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:12.586686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:12.587300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:12.594173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:12.594651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:12.595084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:12.595796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:12.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:12.596686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:12.726059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:12.733624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a6921feb-3b3e-4e13-84f6-907f60bab6ef tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.150857 Aug 24 17:43:12.734772 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 233/476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:12 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:13.105882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:13.106426 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:13.112274 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:13.112789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:13.113216 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:13.113898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:13.114341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:13.114755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:13.243775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:13.251507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8868840d-4605-4e2b-8d38-d599162807f1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.149509 Aug 24 17:43:13.252062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 244/477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:13 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:13.755274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:13.755812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:13.762195 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:13.762672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:13.763106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:13.763784 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:13.764238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:13.764701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:13.889181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:13.897501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b402e22b-59fc-44d2-a522-d81a4b86d335 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.146094 Aug 24 17:43:13.898059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 234/478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:13 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:14.272761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:14.273366 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:14.279260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:14.279740 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:14.280172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:14.280890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:14.281344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:14.281766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:14.411977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:14.419558 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0a9f173f-4469-4a3b-ab83-dea6ed1da9d8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.150738 Aug 24 17:43:14.420135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 245/479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:14 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:14.918623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:14.919366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:14.926874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:14.927358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:14.927919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:14.928647 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:14.929102 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:14.929523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:15.056509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:15.064021 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dd04ea66-dcae-47ed-83e8-85ac2ec05ff7 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.149212 Aug 24 17:43:15.064599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 235/480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:14 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:15.440104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:15.440748 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:15.446629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:15.447108 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:15.447542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:15.448227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:15.448713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:15.449138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:15.573746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:15.581899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a2d0dfdd-0170-42de-8bc7-1862e348a38c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.145657 Aug 24 17:43:15.582461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 246/481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:15 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:16.083989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:16.084708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:16.095348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:16.095845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:16.096282 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:16.097011 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:16.097461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:16.097888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:16.115821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:16.228319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:16.236329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a2ee9381-02e7-4976-a2a3-0adc6bf9fd7d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.156289 Aug 24 17:43:16.236906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 236/482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:16 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:16.602355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:16.602959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:16.608930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:16.610007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:16.610440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:16.611122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:16.611572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:16.611991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:16.738541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:16.746600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c8c3dc51-4c76-4396-8da4-12f0fcdea450 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.147907 Aug 24 17:43:16.747168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 247/483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:16 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:17.257200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:17.257862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:17.264541 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:17.265056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:17.266150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:17.266908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:17.267436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:17.268221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:17.406022 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:17.413788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-58ec5fed-c0eb-4b63-b643-78c1e5cec8dd tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.160813 Aug 24 17:43:17.414354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 237/484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:17 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:17.767106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:17.767715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:17.774184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:17.774665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:17.775093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:17.775782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:17.776229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:17.776711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:17.900801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:17.908838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-26a68765-2ea3-46ec-a5c3-a06e7ce2e8d1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.145563 Aug 24 17:43:17.909397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 248/485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:17 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:18.442482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:18.443098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:18.449234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:18.449731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:18.450165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:18.450858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:18.451315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:18.451740 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:18.582216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:18.589823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dfd1f0f7-2435-403b-935a-46b104fbfbd1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.159363 Aug 24 17:43:18.590381 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 238/486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:18 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:18.930249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:18.930859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:18.936887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:18.937925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:18.938363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:18.939050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:18.939509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:18.939932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:19.065544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:19.073074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5a029eee-8142-44a9-b98f-5bf223c2d9bf tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.146709 Aug 24 17:43:19.073630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 249/487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:18 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:19.611370 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:19.611970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:19.618198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:19.618669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:19.619094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:19.619767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:19.620211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:19.620652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:19.747181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:19.754717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-00e410d4-4c19-4420-93f0-0209da481084 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.147764 Aug 24 17:43:19.755273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 239/488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:19 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:20.093941 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:20.094471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:20.100402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.100907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.101334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.102012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.102458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.102876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.229986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:20.237691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-acc2af6e-a662-43f8-acff-5db6cf0b04f5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.147693 Aug 24 17:43:20.238263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 250/489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:20 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:20.775516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:20.776039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:20.782457 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.782929 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.783354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.784029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.784475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.784918 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.909736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:20.917165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e47bc1c6-4fb5-49c3-b8d9-7adc838a41b0 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.145573 Aug 24 17:43:20.917714 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 240/490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:20 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:21.260011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:21.260653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:21.266483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:21.267472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:21.268139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:21.268850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:21.269297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:21.269713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:21.398549 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:21.406091 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eb0a1b9d-bc80-4627-8b74-6664dee86a32 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.150631 Aug 24 17:43:21.406645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 251/491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:21 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:21.938035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:21.939349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:21.945654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:21.946127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:21.946556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:21.947230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:21.947677 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:21.948094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.074757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:22.082720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-38ecbe17-0c08-4625-9f61-5e015c5144e1 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1314 microversion: 2.1 time: 0.148537 Aug 24 17:43:22.083305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 241/492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:21 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:22.427169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:22.427775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:22.433849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.434338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.434779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.435484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.435942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.436372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.750806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:22.759269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c9ced379-0078-4bed-9815-e8d004c42c48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.335984 Aug 24 17:43:22.759913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 252/493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:22 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:22.993851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "name": "network-vif-plugged", "status": "completed", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:23.006027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.006500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.006922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.017735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] Creating event network-vif-plugged:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:43:23.023110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-5489e6d3-b909-4309-b36b-45bb2b07f05a req-640f8def-92ac-4646-87ae-a1f4efe8a85a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Aug 24 17:43:23.023735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 242/494] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:43:23.103263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:23.103864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:23.109837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.110363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.111475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.112180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.112653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.113070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.116976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:23.241647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:23.249190 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7dec3d3c-ab54-47ca-9696-58b0ef8df1ba tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1499 microversion: 2.1 time: 0.149777 Aug 24 17:43:23.249760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 253/495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:23 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:23.789060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:23.791260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:23.793540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:23.794047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:23.801238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.802071 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.802838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.803901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.805345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.806105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.810392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.811236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.811841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.812600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.814901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.815349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.837211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:43:23.949168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b069d551-cf9b-4434-ba7c-74a514ec1b43 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 204 len: 0 microversion: 2.1 time: 0.158597 Aug 24 17:43:23.954785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 254/496] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:43:23 2022] DELETE /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:43:23.966999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:23.968373 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:23.976893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.979234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.980078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:23.981188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:23.981951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:23.982545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:24.204237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:24.209153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ca08fcdc-d0e1-4218-b684-8d098ed2b594 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.430730 Aug 24 17:43:24.216414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 243/497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:23 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:24.231977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:24.240266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a12637c1-385b-4e91-a942-ee75396c0425 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.283055 Aug 24 17:43:24.240870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 255/498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:23 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:25.230130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:25.230733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:25.237153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.237630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.238063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.238774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.239222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.239639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.262231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:25.262958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:25.269745 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.270230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.270658 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.271348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.271799 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.272221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.414892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:25.422349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cfb25b6e-60ae-4340-a410-f070fb80d476 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.196083 Aug 24 17:43:25.422903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 244/499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:25 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:25.444312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:25.452249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5d05d0e4-d01d-4591-81cb-0f4078ea204b tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.193921 Aug 24 17:43:25.452863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 256/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:25 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:26.443396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:26.443998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:26.450596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.451071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.451498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.452179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.452654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.453073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.474340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:26.475065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:26.481068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.481550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.481997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.482681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.483131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.483553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.643551 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:26.651113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6c09c363-30ea-4865-aef1-72c650057307 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.211754 Aug 24 17:43:26.651669 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 245/501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:26 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:26.656864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:26.665245 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-826bc910-bd81-49fc-b836-9c28588a2bb2 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.195400 Aug 24 17:43:26.665801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 257/502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:26 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:27.671702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:27.672330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:27.679196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.679678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.680102 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.680811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.681261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.681680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.685776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:27.686437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:27.692146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.692657 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.693092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.693779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.694231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.694650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.875579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:27.879692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:27.883164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-acf509a3-275b-4acb-af55-f05bf230fc11 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.215289 Aug 24 17:43:27.883727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 246/503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:27 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:27.887544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e4c91af0-d2f2-49ff-b17d-5e5041cd6595 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.205519 Aug 24 17:43:27.888173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 258/504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:27 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:28.904282 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:28.904910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:28.908400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:28.909042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:28.910919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:28.911397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:28.912829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:28.913896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:28.914357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:28.914777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:28.915067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:28.915551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:28.915978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:28.916687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:28.917209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:28.917555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:29.112710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:29.116880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:29.120321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fc88957f-da14-4e97-a50e-0105bcb00958 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.219895 Aug 24 17:43:29.121119 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 247/505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:28 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:29.124671 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-265191dc-3730-4bf9-bf85-eba856cf3b0c tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.220085 Aug 24 17:43:29.125230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 259/506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:28 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:30.141411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:30.142019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:30.145151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:30.145757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:30.149103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:30.149590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:30.150022 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:30.150838 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:30.152994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:30.152994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:30.153232 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:30.153789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:30.153934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:30.156785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:30.156785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:30.156785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:30.347433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:30.352522 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:30.355090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f8df46ef-e8fb-468f-ab64-4a7d9ee584bc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1369 microversion: 2.1 time: 0.217633 Aug 24 17:43:30.355980 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 248/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:30 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:30.360339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bd1e9d81-a771-4a40-9853-44b9eef9fe2d tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.219609 Aug 24 17:43:30.360913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 260/508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:30 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:31.381873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:31.383385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:31.383892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:31.384723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:31.396476 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.398223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.398661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.399369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.399821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.400238 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.401017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.401855 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.402433 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.403300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.403753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.404167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.709932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:31.716314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f4cb8bb714ccc90b2f2589f9b2a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5f06c64c9a459fa45ba85855d4324f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:31.718793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3f65a683-1c99-4595-88cc-de5793dacb44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1564 microversion: 2.1 time: 0.345649 Aug 24 17:43:31.719996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 249/509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:31 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1564 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:31.741446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-983a16b7-0b3a-44f3-ad49-a4a863d05c18 tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 200 len: 1505 microversion: 2.1 time: 0.363725 Aug 24 17:43:31.742117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 261/510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:31 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:31.745070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:31.745958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:31.753575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.754351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.754959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.755832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.756458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.757048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.895757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a2e02b-ba26-4daa-b9e7-a807115a468a", "name": "network-vif-deleted", "tag": "97b815a3-6afd-4aec-b2cb-6dd80750c19a"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:31.912686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:31.913286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:31.914212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:31.922787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-045b03b9-de58-4e2b-9a9b-0e6ae4da1af3 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184505 Aug 24 17:43:31.925011 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 250/511] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:43:31 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:43:31.945345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] Creating event network-vif-deleted:97b815a3-6afd-4aec-b2cb-6dd80750c19a for instance f5a2e02b-ba26-4daa-b9e7-a807115a468a on hv-cinder-83538 Aug 24 17:43:31.951013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-ddb87058-b655-4fa6-9478-0665cc85d3d5 req-8eecf251-5d50-4f32-ab48-13b5a6e6554b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059030 Aug 24 17:43:31.952183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 262/512] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:43:32.766045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:32.766775 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] [instance: f5a2e02b-ba26-4daa-b9e7-a807115a468a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:32.773695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:32.774277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:32.774898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:32.775596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:32.776050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:32.776474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:32.790420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] HTTP exception thrown: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Request method failure captured: Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a HTTP/1.1 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmLs6s75PFiID0YhUzT_P1X8_xT_6iaKKQ-ntw0Me3MtxOV9IVdrWC_ivpPt9X-wopdKf_48IqhAFFUI6W_7WuZjtir0y5Q73SeLxkolnWsSu-dzpqGD12b2PCiFDsK8hDt2aNYDvwyA9r0r6PTCxwml6tm67B5Z4yOrzCWxTKFmX74 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 8f5f06c64c9a459fa45ba85855d4324f Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesActionsTest-1437805553 Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:43:32.792052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8f5f06c64c9a459fa45ba85855d4324f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesActionsTest-1437805553 Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 8f5f06c64c9a459fa45ba85855d4324f Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesActionsTest-1437805553 Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesActionsTest-1437805553-project Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 757f4cb8bb714ccc90b2f2589f9b2a1e Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesActionsTest-1437805553-project Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. Aug 24 17:43:32.793611 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'f5a2e02b-ba26-4daa-b9e7-a807115a468a'} Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:43:32.794417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. Aug 24 17:43:32.795617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:43:32.796976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] Returning 404 to user: Instance f5a2e02b-ba26-4daa-b9e7-a807115a468a could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:43:32.796976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8f3c1aeb-74da-45df-a335-58f6822710aa tempest-VolumesActionsTest-1437805553 tempest-VolumesActionsTest-1437805553-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a" status: 404 len: 111 microversion: 2.1 time: 0.031880 Aug 24 17:43:32.796976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 251/513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:32 2022] GET /compute/v2.1/servers/f5a2e02b-ba26-4daa-b9e7-a807115a468a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:43:33.131261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:33.142209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:33.143960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:33.144848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:33.158820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] Creating event network-changed:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:43:33.165208 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-d8e64cce-faa1-4f3a-800a-9a77cf0ae7b0 req-a9ca0e80-f3d3-43b7-9c48-3e1192278faf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041172 Aug 24 17:43:33.166216 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 263/514] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:06.018954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=49 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:06.020225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=82 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:06.231900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-14d5aee1-d8e5-4700-b3b5-4268dc709b8a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Action: 'create', calling method: .version_select at 0x7fa666d6f670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1094162370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7thfb1wctv3EYI7dtIl6me0NnhPlU7oCVLs/Drz+/qtcy5R4GlZWWkUdIaHlPLnWWfT5ysmiqKVvXQQ3FibIvsfmZ8oJCQb9WM5MqlwMiE4/fEihHIR568abK6G66Rig=="}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:06.248637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-14d5aee1-d8e5-4700-b3b5-4268dc709b8a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Getting quotas for project f45fcc8295e24580b04787b4040d3612. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:44:06.253357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-14d5aee1-d8e5-4700-b3b5-4268dc709b8a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Getting quotas for user 8d38f974f55d4f27bafdfe06ac9dfebb and project f45fcc8295e24580b04787b4040d3612. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:44:06.277907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-14d5aee1-d8e5-4700-b3b5-4268dc709b8a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266377 Aug 24 17:44:06.278931 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 252/515] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:44:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:44:10.662602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:10.663375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:10.668816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:10.669384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:10.681544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:10.682037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:10.682470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:10.683169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:10.683615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:10.684030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:10.709364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e8bcdd17-e145-4558-b337-e631c5a8297c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/ips" status: 200 len: 150 microversion: 2.1 time: 0.047925 Aug 24 17:44:10.709922 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 264/516] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:44:10 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:11.420275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:11.420897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:11.427372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:11.427854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:11.428293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:11.429015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:11.429476 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:11.429906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:11.453806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c2d633d8-ba86-4f0c-b253-ce168ec59f7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/ips" status: 200 len: 151 microversion: 2.20 time: 0.038212 Aug 24 17:44:11.454359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 253/517] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 24 17:44:11 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:44:12.090882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6031ce6-5164-4248-833e-c1ebeb9129cd"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:12.093235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:12.099729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:12.100212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:12.100679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:12.101368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:12.101821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:12.102246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:12.371970 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-45c0f40f-9d54-4ac3-9c52-5712000e0343 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284826 Aug 24 17:44:12.372592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 265/518] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:44:12 2022] POST /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:13.493298 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:13.493873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:13.500252 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:13.500784 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:13.501222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:13.501910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:13.502363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:13.502822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:13.525533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lazy-loading 'flavor' on Instance uuid 31b745f4-f69f-4b83-a066-cadcb0a95389 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:44:13.712583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cdfda372-804c-4ee8-b6b8-9b4bf02af78c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/action" status: 202 len: 0 microversion: 2.20 time: 0.223070 Aug 24 17:44:13.716446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 254/519] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 17:44:13 2022] POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:44:13.723499 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:13.724354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:13.735873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:13.736356 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:13.736833 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:13.737566 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:13.738023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:13.738441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:13.870277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:13.878697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:13.880192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:13.881381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ae168fd4-536b-4e3b-bead-60a1eedb2eea tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.163314 Aug 24 17:44:13.881936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 266/520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:13 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:14.905660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:14.906359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:14.912791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:14.913265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:14.913692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:14.914376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:14.914847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:14.915263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:15.052068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:15.060124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:15.061654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:15.062795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f431e662-fd24-477f-a1ee-8aee1d1c4296 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.161936 Aug 24 17:44:15.063331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 255/521] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:14 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:16.086611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:16.087216 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:16.093436 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:16.093913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:16.094340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:16.095023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:16.095464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:16.095878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:16.470908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:16.479313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:16.480908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:16.482061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2716399b-d622-42b7-bd1a-d9e091c2d7e8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.399450 Aug 24 17:44:16.482632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 267/522] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:16 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:17.505826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:17.506411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:17.508972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:17.514234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:17.514710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:17.515160 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:17.515809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:17.516260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:17.516713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:17.644463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:17.652968 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:17.654557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:17.655738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6aae0d76-a2b5-48c5-afb2-40d453d00f8a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.154327 Aug 24 17:44:17.656350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 256/523] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:17 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:18.678806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:18.679415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:18.685973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:18.686467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:18.686907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:18.687589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:18.688040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:18.688460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:18.824483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:18.833165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:18.834997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:18.836154 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-00134231-6f76-4069-8484-aaad5d676279 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.161236 Aug 24 17:44:18.836730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 268/524] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:18 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:19.859167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:19.859836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:19.866885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:19.867371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:19.867802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:19.868495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:19.868977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:19.869401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:19.903779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: .version_select at 0x7fa666d92280>, body: {"keypair": {"name": "tempest-keypair-39669028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6yHe/3zkovRHLHYqkDEygWygwSg/losih+9w0smQ8Nwarc043EIaAUGLy5P07rH2KmL/W4f7ROpD+cLzeEFxwdfEFzibQWdIOkRBv6sWUeoqybQsSSD37Y79cPuQkbEw=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:19.919832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:44:19.923572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:44:19.935782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [5fed0698-7736-4e8b-b25a-0bdbae035d1d] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:44:19.996438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:20.004397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:20.005941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:20.007085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d8f8b152-36ab-4758-9ef4-8b224e6e2f05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.151911 Aug 24 17:44:20.007633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 257/525] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:19 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:20.942528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [5fed0698-7736-4e8b-b25a-0bdbae035d1d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 35086. Aug 24 17:44:20.957491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-db2ffd0a-aeaa-43d0-b232-f905f6a8044b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.057549 Aug 24 17:44:20.958095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 269/526] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:44:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:44:21.030262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:21.030996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:21.038255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:21.038742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:21.039184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:21.039877 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:21.040326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:21.040888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:21.177528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:21.186463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:21.187972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:21.189162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c2b7d7f4-8060-4a0b-963c-c8471cd1c816 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.162876 Aug 24 17:44:21.189757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 258/527] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:21 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:22.211773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:22.212450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-896894868", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1229ac7-2636-42fd-bd13-5a97e33445e1"}], "security_groups": [{"name": "tempest-securitygroup--2030804936"}], "key_name": "tempest-keypair-39669028", "user_data": "}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:22.212850 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:22.218780 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:22.219262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:22.219717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:22.220410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:22.220904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:22.221328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:22.413555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] validate_networks() for [('b1229ac7-2636-42fd-bd13-5a97e33445e1', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:44:22.448277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:22.456368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:22.457896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:22.459026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6e5d26d1-0eeb-48f0-8bcd-567e2febc755 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.251898 Aug 24 17:44:22.459575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 259/528] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:22 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:44:22.793698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:44:22.794153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:44:22.794629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:44:22.795031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:44:22.795446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:44:22.804815 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:22.805294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:22.805721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:22.806471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:22.806916 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:22.807389 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:22.824845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:44:22.828739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:44:22.839471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:44:22.841761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:44:22.889783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [4ef3c6aa-8406-4997-ae99-429e1389fe3e] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:44:23.482599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:23.483201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:23.489528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:23.490001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:23.490429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:23.491099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:23.491542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:23.491957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:23.620034 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:23.628263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:23.629791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:23.630955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d7a7b3a-0276-429b-8b8b-3eedc501db7a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.152198 Aug 24 17:44:23.631477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 260/529] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:23 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:44:23.898674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [4ef3c6aa-8406-4997-ae99-429e1389fe3e] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 35122. Aug 24 17:44:23.902791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e5230557-19c2-4ae3-8515-271525a0904a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.695943 Aug 24 17:44:23.903481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 270/530] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:44:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:44:23.913856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-51454490-2838-41ba-a384-e10a58d5fd93 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:23.914468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-51454490-2838-41ba-a384-e10a58d5fd93 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:23.973204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51454490-2838-41ba-a384-e10a58d5fd93 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:23.980030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-51454490-2838-41ba-a384-e10a58d5fd93 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1239 microversion: 2.1 time: 0.069952 Aug 24 17:44:23.980620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 261/531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:23 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:24.654303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:24.654902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:24.661479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:24.661954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:24.662887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:24.663563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:24.664006 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:24.664419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:24.789395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:24.798677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:24.800355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:24.802239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-77233b44-8bfd-4de6-a064-44b9b78ac3b7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.151875 Aug 24 17:44:24.802424 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 271/532] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:24 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:25.000685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:25.001825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:25.007864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:25.008345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:25.008810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:25.009552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:25.010004 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:25.010429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:25.093176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:25.101574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cf88fc2e-234f-4f4e-96a9-9dbf380de9f1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1297 microversion: 2.1 time: 0.105396 Aug 24 17:44:25.102141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 262/533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:24 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:25.825976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:25.826488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:25.832847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:25.833332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:25.833769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:25.834490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:25.834944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:25.835369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:26.027135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:26.036619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:26.038748 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:26.040087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-14d42e25-afcc-41da-a8eb-fcfdf6c39c2f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.218097 Aug 24 17:44:26.040813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 272/534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:25 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:26.123182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:26.123698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:26.130124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:26.130594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:26.131097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:26.131786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:26.132240 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:26.132689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:26.316329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:26.324054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6694d151-c36d-467a-ae00-47129d13d404 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.205059 Aug 24 17:44:26.334765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 263/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:26 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:26.359203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e5570a-2379-45a8-935b-116885887681", "tag": "2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:26.369934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:26.370416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:26.370850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:26.381585 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] Creating event network-changed:2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91 for instance 50e5570a-2379-45a8-935b-116885887681 on hv-cinder-83538 Aug 24 17:44:26.386427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-150746f7-6f34-42a5-8657-6a576a87d666 req-6c1e4f16-d630-4317-904a-04725646dfb3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030857 Aug 24 17:44:26.387026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 273/536] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:44:27.063337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:27.063973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:27.069826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:27.070305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:27.070739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:27.071423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:27.071874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:27.072295 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:27.239050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:27.247285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:27.248821 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:27.249962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d0b28878-69e0-4177-8dad-1e2eed6c4cc7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.190598 Aug 24 17:44:27.250511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 264/537] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:27 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:27.355605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:27.356293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:27.362502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:27.363004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:27.363440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:27.364119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:27.364616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:27.365037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:27.496633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:27.504384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-637552c1-836f-404d-b9ac-db594ae2f6a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.153393 Aug 24 17:44:27.505755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 274/538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:27 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:28.274538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:28.275162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:28.281626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:28.282113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:28.282582 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:28.283280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:28.283735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:28.284167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:28.408659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:28.417357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:28.418878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:28.420037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ea214172-772b-46f8-98a2-7051a597ea74 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.149740 Aug 24 17:44:28.420603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 265/539] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:28 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:28.527247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:28.527783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:28.534134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:28.534610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:28.535041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:28.535819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:28.536276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:28.536730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:28.666817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:28.674239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0f90b397-a123-4a03-b6a6-2e8026818a5e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.150908 Aug 24 17:44:28.674808 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 275/540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:28 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:29.442682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:29.443296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:29.449690 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:29.450170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:29.450604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:29.451290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:29.451742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:29.452163 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:29.578158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:29.586809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:29.588318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:29.589490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8e17757d-485f-4ee0-8ca2-2da4cdc00e15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.150705 Aug 24 17:44:29.590043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 266/541] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:29 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:29.697066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:29.697599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:29.703847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:29.704331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:29.704772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:29.705444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:29.705885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:29.706298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:29.836732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:29.844343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c2aef706-9a9c-414a-a54d-6f8c27fde19e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.152959 Aug 24 17:44:29.844934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 276/542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:29 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:30.612703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:30.613311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:30.620287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:30.620795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:30.621224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:30.621898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:30.622344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:30.622765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:30.748328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:30.756777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:30.758271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:30.759403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b3778d82-3fde-48e4-aede-b65830361a1a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.150616 Aug 24 17:44:30.759950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 267/543] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:30 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:30.865166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:30.865716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:30.872013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:30.872483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:30.872948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:30.873637 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:30.874081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:30.874498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:31.002242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:31.010901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-748b947a-6390-4bdd-b9f3-e5cd77784a7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.149578 Aug 24 17:44:31.011492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 277/544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:30 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:31.783148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:31.783662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:31.790708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:31.791184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:31.791614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:31.792297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:31.792788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:31.793214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:31.919449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1075981170", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1094162370", "security_groups": [{"name": "tempest-secgroup-smoke-791501172"}], "networks": [{"uuid": "91e950c3-ae8b-4c15-b371-2f82f41ba203"}], "block_device_mapping_v2": [{"uuid": "f38a1f31-dfc5-49ab-92ff-7be9df93fddf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:31.938930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:31.942530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:31.948763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:31.950281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:31.951437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-28c74c02-1070-4c0f-a384-0c0620825a4c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.172331 Aug 24 17:44:31.951993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 268/545] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:31 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:32.033328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] validate_networks() for [('91e950c3-ae8b-4c15-b371-2f82f41ba203', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:44:32.033495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:32.033873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:32.041633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.042130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.042566 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:32.043265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.043728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.044183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:32.231615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:32.239401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-005b0a87-3f8d-4bae-a263-483041924041 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.210542 Aug 24 17:44:32.239971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 269/546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:32 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:44:32.460841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:44:32.461264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:44:32.461736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:44:32.462142 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:44:32.462551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:44:32.471243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.471716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.472145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:32.472903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.473354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.473779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:32.490177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Getting quotas for project f45fcc8295e24580b04787b4040d3612. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:44:32.494580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Getting quotas for user 8d38f974f55d4f27bafdfe06ac9dfebb and project f45fcc8295e24580b04787b4040d3612. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:44:32.556694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:44:32.558921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f38a1f31-dfc5-49ab-92ff-7be9df93fddf',volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:44:32.688294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d746a3c6-950e-4345-a2c4-338b3d0e5865 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772638 Aug 24 17:44:32.688971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 278/547] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:44:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:44:32.700220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9b1bbd42-49ff-4248-bf3f-f43a09bdb201 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:32.700854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9b1bbd42-49ff-4248-bf3f-f43a09bdb201 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:32.756173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9b1bbd42-49ff-4248-bf3f-f43a09bdb201 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:32.763663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9b1bbd42-49ff-4248-bf3f-f43a09bdb201 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1089 microversion: 2.1 time: 0.067137 Aug 24 17:44:32.764243 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 270/548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:32 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:32.977171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:32.977808 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:32.984489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.984992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.985419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:32.986105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:32.986586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:32.987045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:33.125384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:33.134534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:33.136088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:33.137271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-95bb9694-9ac8-46fd-8fd4-39897d13ea62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.166523 Aug 24 17:44:33.137819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 279/549] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:32 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:33.259694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:33.260504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:33.268626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:33.269122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:33.269533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:33.270224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:33.270812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:33.271509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:33.409364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:33.418872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-30119d2b-16fd-4600-91e2-7db94ffa201a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.162916 Aug 24 17:44:33.419439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 271/550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:33 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:33.785450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:33.786667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:33.794058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:33.794821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:33.795266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:33.796427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:33.796537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:33.797040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:33.895595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:33.904732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8fa24cc7-8d38-4d9c-a232-73e6cf99494d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1195 microversion: 2.1 time: 0.123348 Aug 24 17:44:33.905368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 280/551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:33 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1195 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:34.161058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:34.161672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:34.167856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.168345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.168816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:34.169520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.169974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.170413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:34.440084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:34.440732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:34.447801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.448343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.448851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:34.449617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.450096 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.450824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:34.452774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:34.466701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:34.468206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:34.469389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7e14dbd1-2bbb-4c27-85a2-881c198bd406 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.312283 Aug 24 17:44:34.480902 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 272/552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:34 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:34.670051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:34.677763 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7ec47d8a-2821-478c-9c54-3568a18473b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.241771 Aug 24 17:44:34.678342 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 281/553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:34 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:44:34.925323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:34.925930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:34.932522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.933054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.933490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:34.934544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:34.935158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:34.935759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.140836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:35.149536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a9933b3c-9248-4ae8-97cd-3f0ee8a4a004 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.228055 Aug 24 17:44:35.150101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 273/554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:34 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:44:35.494122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:35.495176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:35.502322 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.503025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.503463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.504165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.504679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.505260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.531364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e5570a-2379-45a8-935b-116885887681", "name": "network-vif-plugged", "status": "completed", "tag": "2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:35.536732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:35.550741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.551237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.551856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.568436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] Creating event network-vif-plugged:2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91 for instance 50e5570a-2379-45a8-935b-116885887681 on hv-cinder-83538 Aug 24 17:44:35.574498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-e6d97437-602e-4e4d-9a5d-b39859269f7b req-2339afb2-91c2-4ab1-9d44-643b6843ae6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Aug 24 17:44:35.575173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 274/555] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:35.706606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:35.707637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:35.718060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.718465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.719073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.719788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.720244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.720697 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.855192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:35.863471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:35.864990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:35.866170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b5468397-8365-4eb0-b3aa-6bbfd960ca52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.377026 Aug 24 17:44:35.880420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 282/556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:35 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:35.880420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:35.885737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:35.886207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:35.886630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:35.900105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] Creating event network-changed:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:44:35.905212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-b5accb43-28b8-423c-bac3-066be49b0934 req-873f0d05-1fdd-4f02-a219-b5828d15f18a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036139 Aug 24 17:44:35.906122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 283/557] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:36.043290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:36.051197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-41f7b078-90e9-4270-930d-bf5fadd6e59b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.356380 Aug 24 17:44:36.051760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 275/558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:35 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:36.170765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:36.171447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:36.177517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:36.177990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:36.178412 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:36.179580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:36.180021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:36.180432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:36.314238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:36.322394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-48480c82-b3e0-45e5-8de0-483b8ea5f58d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.155813 Aug 24 17:44:36.322960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 284/559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:36 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:36.890444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:36.891028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:36.893458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:36.899328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:36.899809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:36.900246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:36.900967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:36.901426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:36.901854 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:37.041169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:37.042661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:37.043796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1fde2a27-1983-4b14-9d0b-d9d3e00976a0 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.157324 Aug 24 17:44:37.044350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 276/560] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:36 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:37.071836 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:37.072445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:37.078745 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:37.079216 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:37.079641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.080314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:37.080783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:37.081201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.204458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:37.216796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6c6b6070-0dcf-421c-9fe5-74f6df573a54 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.148881 Aug 24 17:44:37.217357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 285/561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:37 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:37.342658 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:37.343265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:37.349139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:37.349610 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:37.350048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.350730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:37.351177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:37.351593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.484036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:37.491977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9b5dea67-a284-4aa9-ad11-76c1de74846a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.153116 Aug 24 17:44:37.492586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 277/562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:37 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:37.589973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "name": "network-vif-plugged", "status": "completed", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:37.599132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:37.599600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:37.600020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:37.610530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] Creating event network-vif-plugged:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:44:37.615512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-994189c4-713f-4b04-8496-1a3647e0ee16 req-2e036d94-4d22-4b90-bb1c-a74aac73c31d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029779 Aug 24 17:44:37.616062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 286/563] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:38.066384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:38.066946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:38.073395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.073873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.074307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.074989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.075441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.075864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.204264 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:38.212319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:38.213868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:38.215010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3e9b6267-6af1-4c4a-b0ad-6b47ac3438b1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.152630 Aug 24 17:44:38.215561 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 278/564] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:38 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:38.242814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:38.243503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:38.250100 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.250570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.250995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.251677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.252122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.252537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.383316 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:38.390976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3ba3141d-705a-4c9d-9cec-e07288d48dfc tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1365 microversion: 2.1 time: 0.156922 Aug 24 17:44:38.391536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 287/565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:38 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:38.512696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:38.513303 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:38.519189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.519659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.520083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.520779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:38.521481 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:38.521896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:38.651553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:38.659195 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-515306a4-ae08-4e6a-8068-dba9d5dd3e31 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.150421 Aug 24 17:44:38.659753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 279/566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:38 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:44:39.238040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:39.238703 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:39.244788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.245389 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.245677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.246353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.246801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.247218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.375464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:39.383493 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:39.385031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:39.386203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-83ff89f3-e278-44f0-8d95-a2a3f96b5235 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.152124 Aug 24 17:44:39.386760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 288/567] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:39 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:39.411729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:39.412463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:39.419465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.419941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.420372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.421094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.421537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.421959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.550510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:39.558113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-09f4fb89-a661-4885-8b85-38349a2f8bff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1555 microversion: 2.1 time: 0.150340 Aug 24 17:44:39.558680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 280/568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:39 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:39.578396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:39.578869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:39.584692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.585167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.586185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.586857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.587298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.587710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.680174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:39.680522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:39.683498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-82ea5898-bcd9-40c3-98f5-22b56e30a873 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108451 Aug 24 17:44:39.686940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 289/569] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:44:39 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:39.687089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.687293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.687731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.688427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:39.688908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:39.689327 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:39.901680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:39.910870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dcdd2938-a289-4aa4-8ecf-1372ebffb168 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.235463 Aug 24 17:44:39.911650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 281/570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:39 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:44:40.410055 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:40.410819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:40.416712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:40.417277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:40.417790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:40.418474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:40.418921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:40.419334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:40.560523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:40.570173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:40.573192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:40.574579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b1d0afeb-7438-42a5-94ec-2f0c83f7f795 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1744 microversion: 2.20 time: 0.168936 Aug 24 17:44:40.575462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 290/571] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:40 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:40.610211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e5570a-2379-45a8-935b-116885887681", "tag": "2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:40.621095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:40.621574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:40.622007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:40.633558 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] Creating event network-changed:2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91 for instance 50e5570a-2379-45a8-935b-116885887681 on hv-cinder-83538 Aug 24 17:44:40.638711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-8eb290e9-ad4e-4015-a367-0118521c0192 req-3db91b4a-2481-4955-a6a4-32cd87dbd071 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032248 Aug 24 17:44:40.639648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 282/572] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:40.933183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:40.934051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:40.945729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:40.947101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:40.947580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:40.948116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:40.948730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:40.949350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:40.949928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:41.190713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:41.200982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e12c12b5-0b9e-45f6-b043-a85a49dce714 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.272121 Aug 24 17:44:41.204744 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 291/573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:40 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:41.599178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:41.600156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:41.607528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:41.608022 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:41.608468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:41.609259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:41.609718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:41.610141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:41.769705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:41.793123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:41.795353 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:41.796824 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-70ab1e7d-fae4-4068-a404-70486da9d715 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.202147 Aug 24 17:44:41.813526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 283/574] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:41 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:42.227321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:42.228667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:42.234795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:42.235268 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:42.235912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:42.236617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:42.237307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:42.237722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:42.387097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:42.395234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-51d555fa-487b-42d7-901d-705d0dcee864 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.172909 Aug 24 17:44:42.395808 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 292/575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:42 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:42.819880 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:42.820490 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:42.823182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:42.829255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:42.829996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:42.830629 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:42.831511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:42.831960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:42.832387 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:42.984377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:42.993682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:42.995207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:42.996581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e4ed6203-50e7-4a48-8797-faa5c3a16c25 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.181185 Aug 24 17:44:42.997432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 284/576] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:42 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:43.416542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:43.417912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:43.419883 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:43.420567 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=16 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:43.426814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:43.427298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:43.427920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:43.428891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:43.430107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:43.430691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:43.593909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:43.606361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-95e7640f-0071-4a41-8971-29fc5b06f3ef tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.194682 Aug 24 17:44:43.620425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 293/577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:43 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:44.019445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:44.020920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:44.029201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:44.029947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:44.030363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:44.031227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:44.031826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:44.032404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:44.176271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:44.185082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:44.186906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:44.188376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e606523d-5e29-4aba-8261-10299fb46a1b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.172949 Aug 24 17:44:44.189193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 285/578] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:44 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:44.627414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:44.628786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:44.636332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:44.637139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:44.637669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:44.638622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:44.639172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:44.639807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:44.783518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:44.792313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3ca7d84f-c28e-4534-bd5f-01b1a59701d9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.168714 Aug 24 17:44:44.806528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 294/579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:44 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:45.211887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:45.213153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:45.219745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:45.220229 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:45.220718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:45.221428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:45.221876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:45.222474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:45.362271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:45.371070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:45.372927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:45.374315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9dfc047b-3c28-4ef7-90a3-5a1f4ada0d67 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.166997 Aug 24 17:44:45.388783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 286/580] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:45 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:45.813840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:45.814651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:45.822473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:45.823320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:45.823984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:45.824836 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:45.825338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:45.825975 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:45.967873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:45.976187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b92bf8cd-0a5a-4c64-8b01-054075b3791d tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.166317 Aug 24 17:44:45.976958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 295/581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:45 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:46.400616 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:46.401445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:46.407453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:46.408382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:46.408916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:46.409707 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:46.410162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:46.410591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:46.561612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:46.565103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=100 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:46.570877 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:46.572736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:46.573910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-07d1c9fb-f6c0-4dd0-a513-772f78aa5cf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.179882 Aug 24 17:44:46.575366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 287/582] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:46 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:46.996439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:46.997952 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:47.004862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:47.005630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:47.006060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:47.006756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:47.007768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:47.008191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:47.145482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:47.154568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9d8e8bfb-6e3e-421b-9d94-628f32a9434e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.161972 Aug 24 17:44:47.155239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 296/583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:46 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:47.597540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:47.598247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:47.607445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:47.608029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:47.608528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:47.609356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:47.609895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:47.610415 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:47.751696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:47.767134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:47.769598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:47.770991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6b75821e-d723-43a3-a3f0-4cd4097a2d41 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.177578 Aug 24 17:44:47.771971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 288/584] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:47 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:48.175346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:48.176785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:48.184317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:48.184905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:48.185583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:48.186518 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:48.187059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:48.187552 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:48.333130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:48.341170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7002ee7a-9898-404e-b825-0d9f6c5f58a7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.169983 Aug 24 17:44:48.342022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 297/585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:48 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:48.795319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:48.796644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:48.803533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:48.804734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:48.805411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:48.806104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:48.806553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:48.806971 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:48.942533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:48.951190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:48.952693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:48.953976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-07ca7e2f-31ae-4253-801d-90a7a4f67ebc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.162634 Aug 24 17:44:48.954961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 289/586] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:48 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:49.364698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:49.365437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:49.372321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:49.372860 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:49.373294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:49.374021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:49.374472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:49.374886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:49.482701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:49.502861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:49.502861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:49.502861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:49.517649 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] Creating event network-vif-plugged:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:44:49.526423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-be68a951-eca8-41c5-887d-39d2648a845c req-a7660c83-e576-4b79-ae7e-9ade97c02e37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047925 Aug 24 17:44:49.527540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 290/587] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:44:49.528285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:49.549338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dfcf981c-6774-4929-998f-b2fdbb96f102 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.190989 Aug 24 17:44:49.582294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 298/588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:49 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:49.978957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:49.979752 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:49.986204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:49.986684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:49.987124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:49.988208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:49.988723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:49.989138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:50.122412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:50.130386 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:50.131873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:50.133814 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-592ab2d8-1f29-4441-af82-8cd468baab11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.159847 Aug 24 17:44:50.134365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 291/589] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:49 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:50.576152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:50.576800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:50.583495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:50.583592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:50.584014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:50.584880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:50.585884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:50.586305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:50.717669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:50.725207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-392040e0-1ade-4550-bbe6-102a79fc3d60 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1260 microversion: 2.1 time: 0.153070 Aug 24 17:44:50.725763 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 299/590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:50 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:51.157096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:51.157704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:51.164774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.165254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.165687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:51.166435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.166835 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.167260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:51.291246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:51.299269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:51.300805 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:51.301946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-48387b16-31d9-4c04-a735-a20cf1f8a481 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1739 microversion: 2.20 time: 0.148728 Aug 24 17:44:51.302500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 292/591] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:51 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:51.746440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:51.747049 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:51.753739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.754329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.754826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:51.755759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.756334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.756852 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:51.886299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:51.889856 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:44:51.894982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e65ab886-7077-4fc0-b5c4-29b0ee7c62c5 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1444 microversion: 2.1 time: 0.153293 Aug 24 17:44:51.895541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 300/592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:51 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:51.915389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:51.915994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:51.921858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.922337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.922773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:51.923453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:51.923903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:51.924324 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:52.051270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:52.059430 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fc786515-cd73-4956-9f2a-e1ddff60ff27 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1444 microversion: 2.1 time: 0.147923 Aug 24 17:44:52.059989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 293/593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:44:51 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:44:52.325333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:52.326221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:52.333226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:52.333775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:52.334265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:52.335267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:52.335774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:52.336773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:52.800300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:52.809413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:52.811271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:52.812667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ca1b7433-f6f2-4990-96e1-e3c5b6facf3a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1721 microversion: 2.20 time: 0.492019 Aug 24 17:44:52.813398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 301/594] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:52 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1721 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:53.836306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:53.836946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:53.843495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:53.843977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:53.844410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:53.845140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:53.845598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:53.846019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:53.939569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:53.957869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:53.960611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:53.961308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:53.973467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] Creating event network-changed:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:44:53.979358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-dd6ba3b4-c0ee-4e7a-ade5-11caf107c754 req-523b814d-5334-4222-8ca9-ab119a81c680 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043524 Aug 24 17:44:53.980229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 302/595] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:44:53.985058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:53.993771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:53.995324 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:53.996515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-08706ce4-e3f7-410f-989b-ebb217e61b97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1721 microversion: 2.20 time: 0.164160 Aug 24 17:44:53.997097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 294/596] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:53 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:55.020346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:55.021064 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:55.027354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.027830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.028260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.028974 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.029601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.029841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.222991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.231510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.233196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.234402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-84054a3e-3469-4592-a162-755c043f16ae tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1724 microversion: 2.20 time: 0.218844 Aug 24 17:44:55.234960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 303/597] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:55 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:55.258033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c056486c-f484-4f7f-a6d0-0b7542126879"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:55.260345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:55.267918 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.268409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.268916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.269646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.270149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.270577 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.429846 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "name": "network-vif-unplugged", "status": "completed", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:55.439662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.440145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.440588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.452229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.compute.server_external_events [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] Unable to find a host for instance 31b745f4-f69f-4b83-a066-cadcb0a95389. Dropping event network-vif-unplugged {{(pid=127241) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 17:44:55.453446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-94eb2915-8490-489b-af60-4a6a78eb9ac9 req-323babaf-3bc4-46d3-8c75-6c06c43495d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028245 Aug 24 17:44:55.454230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 304/598] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 17:44:55.575050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-65c92d56-df8b-4f30-8831-1d36a15d8772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321646 Aug 24 17:44:55.575651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 295/599] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 24 17:44:55 2022] POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:44:55.696767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:44:55.697371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:55.703264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.703744 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.704178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.704892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.705347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.705771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.747203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127241) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:44:55.815553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6f195264-ebf7-4354-b1c7-e9bd758bae9e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/action" status: 202 len: 0 microversion: 2.20 time: 0.122634 Aug 24 17:44:55.816291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 305/600] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 17:44:55 2022] POST /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:44:55.824808 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:55.825423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:55.831963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.832684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.833128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.833825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:55.834279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:55.834705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:55.965830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.974656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.976885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:55.978045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-abf935cd-0b42-4f5f-b4da-d112b9bc7e0b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1750 microversion: 2.20 time: 0.157244 Aug 24 17:44:55.978599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 296/601] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:55 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:57.000992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:57.001665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:57.007475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:57.007951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:57.008381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:57.009093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:57.009539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:57.009954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:57.137299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:57.145956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:57.147703 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:57.149661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-07ba7239-af6e-4d18-8324-e8391d91582f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1752 microversion: 2.20 time: 0.153146 Aug 24 17:44:57.150214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 306/602] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:56 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:58.173771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:58.174369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:58.181150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:58.181626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:58.182051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:58.182731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:58.183182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:58.183600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:58.389185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:58.397952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:58.399964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:58.401165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f96ff065-be1c-406f-bd9a-5aec074ae11c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.231319 Aug 24 17:44:58.401721 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 297/603] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:58 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:44:59.423715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:44:59.424318 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:44:59.431244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:59.431729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:59.432166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:59.432869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:44:59.433321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:44:59.433741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:44:59.565896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:59.575104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:59.576603 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:44:59.577750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-02a0fd75-5fa9-4c48-add0-bd6cff97b54d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.158000 Aug 24 17:44:59.578353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 307/604] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:44:59 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:00.600861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:00.601499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:00.609203 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:00.609692 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:00.610128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:00.615464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:00.615955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:00.616391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:00.745338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:00.753820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:00.755328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:00.756448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-71df3894-66f0-4f1b-b358-589500b38e73 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.159527 Aug 24 17:45:00.757038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 298/605] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:00 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:01.780130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:01.780761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:01.787291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:01.787766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:01.788195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:01.788898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:01.789345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:01.790381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:01.932103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:01.940993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:01.942498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:01.943736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b35b768b-e477-4815-9752-c34dd6b4a21f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.167460 Aug 24 17:45:01.944297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 308/606] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:01 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:45:02.966794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:02.968131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:02.975329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:02.976191 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:02.976969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:02.978441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:02.979114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:02.979753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:03.112417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:03.121783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:03.123284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:03.124427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3155049a-ab03-45db-9447-dbbd9720ed0d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.161584 Aug 24 17:45:03.125030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 299/607] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:02 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:04.148003 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:04.148657 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:04.155943 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:04.156519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:04.157077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:04.157884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:04.173201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:04.173671 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:04.310165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:04.319289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:04.321479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:04.322707 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cfc81968-1e95-44bd-b9af-1449382a0fcb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.179266 Aug 24 17:45:04.323481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 309/608] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:04 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:05.347077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:05.347648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:05.354727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:05.355207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:05.355641 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:05.356328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:05.356840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:05.357259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:05.511223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:05.519922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:05.521465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:05.522890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b9c8e284-74b5-4ff6-a938-b9d405023e0c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.179731 Aug 24 17:45:05.523441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 300/609] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:05 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:06.546746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:06.547446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:06.553998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:06.554487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:06.554924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:06.556280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:06.556807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:06.557232 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:06.690769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:06.699720 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:06.701353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:06.703347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5ff0a9fe-a4bc-4df1-bc4b-f0a86093e874 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.159672 Aug 24 17:45:06.704322 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 310/610] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:06 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:07.731225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:07.731878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:07.734338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=50 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:07.739868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:07.740348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:07.740820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:07.741512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:07.741959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:07.742383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:07.880134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:07.889264 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:07.890767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:07.891916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b90d51de-723a-44c2-b152-35e59e557777 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.164733 Aug 24 17:45:07.892472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 301/611] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:07 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:08.915266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:08.915799 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:08.922301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:08.922781 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:08.923220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:08.923907 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:08.924361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:08.924809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:09.075947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:09.084948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:09.086451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:09.088981 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3e653c3b-7005-4214-8d68-073e46e161e7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.177605 Aug 24 17:45:09.089682 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 311/612] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:08 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:45:10.111438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:10.112027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:10.118272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:10.118749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:10.119174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:10.119853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:10.120299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:10.120747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:10.138056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:10.259093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:10.267796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:10.269344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:10.270497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-14cf9489-7d46-4203-97d2-b5b644d5fc5c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.163190 Aug 24 17:45:10.271050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 302/613] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:10 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:11.294985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:11.295626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:11.298204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:11.303168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:11.303644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:11.304074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:11.304793 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:11.305244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:11.306291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:11.439299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:11.449312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:11.450846 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:11.452112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1cae734f-4e7c-4ae2-abe3-d36f432636e9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.161081 Aug 24 17:45:11.465189 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 312/614] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:11 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:12.476573 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:12.477826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:12.484257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:12.484756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:12.485186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:12.485862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:12.486305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:12.486722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:12.669477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:12.678027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:12.679513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:12.680808 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dcd8ff0e-3a90-4d78-81f4-c9fbe84de9f9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.207995 Aug 24 17:45:12.681357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 303/615] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:12 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:13.703731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:13.704326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:13.710393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:13.710865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:13.711298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:13.712634 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:13.713081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:13.713494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:13.885775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:13.894301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:13.895835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:13.897008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7b9aec1c-3aaa-4ba5-924f-5079692c2433 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.197167 Aug 24 17:45:13.897560 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 313/616] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:13 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:14.920591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:14.921193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:14.927689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:14.928172 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:14.928636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:14.929323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:14.929777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:14.930200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:15.054948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:15.064185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:15.065777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:15.066926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0d222a72-cbd2-4683-9222-29a1a00ebf04 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.150291 Aug 24 17:45:15.067483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 304/617] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:14 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:15.385355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c501da7-8665-4ab0-a279-485a055fbae9"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:15.387549 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:15.394429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:15.394903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:15.395330 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:15.396014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:15.396460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:15.396931 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:16.090190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:16.090848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:16.097745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:16.098306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:16.098746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:16.099440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:16.100046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:16.100309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:16.204654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c8b2bdbc-2def-4ad5-80fd-71ad27cc9226 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822849 Aug 24 17:45:16.205265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 314/618] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:45:15 2022] POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:16.244824 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:16.254444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:16.255928 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:16.257125 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f34fc794-d595-4754-9300-723d58ba0603 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.171235 Aug 24 17:45:16.269789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 305/619] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:16 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:45:17.281599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:17.282262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:17.288612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:17.289089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:17.289513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:17.290234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:17.290678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:17.291094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:17.417619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:17.426193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:17.427722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:17.428896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-984a608a-71d0-4f9f-b463-f99d56f2761d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.151496 Aug 24 17:45:17.429449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 315/620] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:17 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:18.451105 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:18.451705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:18.457996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:18.458473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:18.458904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:18.459589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:18.460039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:18.460460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:18.592208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:18.600765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:18.602313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:18.603465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d9be48fc-b145-40ce-8d68-e947c04d5c0a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.156240 Aug 24 17:45:18.604024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 306/621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:18 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:19.625717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:19.626326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:19.632714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:19.633191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:19.633620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:19.634293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:19.634746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:19.635164 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:19.653513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:19.763060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:19.771637 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:19.773443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:19.775106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-57056088-8457-4af2-af9f-e6ffe8ef757a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.153242 Aug 24 17:45:19.775875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 316/622] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:19 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:20.798732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:20.799290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:20.806374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:20.806853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:20.807287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:20.807967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:20.808417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:20.808870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:20.934004 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:20.942576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:20.944073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:20.945262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ac582fea-90b5-4e10-970e-8c1c750e7c3f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.150515 Aug 24 17:45:20.945825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 307/623] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:20 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:21.967450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:21.968080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:21.974634 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:21.975117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:21.975546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:21.976227 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:21.976714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:21.977133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:22.108232 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:22.116761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:22.118784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:22.119926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1ab85dc0-a1c4-4813-bef8-daccd98f824b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.156586 Aug 24 17:45:22.120483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 317/624] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:21 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:23.143200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:23.143805 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:23.151162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:23.151634 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:23.152063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:23.152774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:23.153222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:23.153640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:23.282710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:23.291185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:23.292705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:23.293841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f6d33beb-ea5d-4057-a753-ec739c155b68 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.154619 Aug 24 17:45:23.294391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 308/625] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:23 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:24.316733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:24.317348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:24.323659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:24.324135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:24.324826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:24.326420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:24.326420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:24.326959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:24.531870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:24.541299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:24.542813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:24.544015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-71766fd8-b8b9-4431-8ff6-b3fae452783b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.231194 Aug 24 17:45:24.544843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 318/626] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:24 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:24.942734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:24.945068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:24.951393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:24.951868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:24.952302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:24.953020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:24.953470 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:24.953889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:24.976158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lazy-loading 'flavor' on Instance uuid 424f0287-eef6-4fa1-95d1-d811e5199185 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:45:25.094812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-64a35b4e-268e-4985-878b-b8cf0093e2c7 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/action" status: 200 len: 32 microversion: 2.1 time: 0.155971 Aug 24 17:45:25.095413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 309/627] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:45:24 2022] POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:45:25.105667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:25.106276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:25.112196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:25.112728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:25.113151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:25.113852 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:25.114304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:25.114737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:25.325526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:25.333787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1a303d5c-0f82-4e7f-ad4c-f52ff95823a8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.232638 Aug 24 17:45:25.334361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 319/628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:25 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:25.571749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:25.572569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:25.580956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "name": "network-vif-plugged", "status": "completed", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:25.581930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:25.582417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:25.582848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:25.583542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:25.583989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:25.584586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:25.601472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:25.601946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:25.602402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:25.615459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] Creating event network-vif-plugged:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:45:25.623915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-4017a49a-7362-478a-88ae-379cf9758959 req-4b495b45-bf95-473f-8b63-5939500b0e98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046747 Aug 24 17:45:25.625961 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 320/629] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:25.774907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:25.783592 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:25.785146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:25.786343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8ccc95d1-86fd-46a1-900d-b1b80eb643bd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.221478 Aug 24 17:45:25.786913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 310/630] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:25 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:26.357298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:26.358676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:26.365063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:26.365538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:26.366040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:26.366729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:26.367178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:26.367597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:26.498222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:26.509000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-70efe95b-81a3-436b-b5bd-bbddd81c7ebd tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.156493 Aug 24 17:45:26.510368 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 321/631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:26 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:26.809080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:26.809686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:26.816044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:26.816570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:26.817009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:26.817693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:26.818153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:26.818576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:26.958325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:26.982237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:26.983743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:26.984994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-53ae26c0-7992-4f6c-8bc0-d29ed9c2eded tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.179749 Aug 24 17:45:26.985740 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 311/632] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:26 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:27.532798 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:27.533417 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:27.539723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:27.540203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:27.540662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:27.541345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:27.541795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:27.542213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:27.666997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:27.675066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7af67947-f955-4d42-8a83-ddcfd84022dc tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.146230 Aug 24 17:45:27.675623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 322/633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:27 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:45:28.007822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:28.008436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:28.015545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:28.016033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:28.016468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:28.017180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:28.017634 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:28.018060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:28.148066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:28.156949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:28.158477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:28.159620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-51e1f693-6463-4a10-9a93-d99aa2561fcc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1808 microversion: 2.20 time: 0.155785 Aug 24 17:45:28.160185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 312/634] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:28 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:28.696357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:28.697131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:28.703635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:28.704333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:28.704890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:28.705523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:28.706074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:28.706546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:28.843941 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:28.853340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bc0c57d9-5220-425f-8575-ca1b4ed98637 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.160730 Aug 24 17:45:28.853995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 323/635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:28 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:29.182623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:29.183349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:29.189457 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:29.189939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:29.190375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:29.191058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:29.191511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:29.191939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:29.323161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:29.331782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:29.333321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:29.334474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-04028e5a-5f0b-4577-9d36-d54298b56e20 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1795 microversion: 2.20 time: 0.155760 Aug 24 17:45:29.335023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 313/636] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:45:29 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:45:29.874938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:29.875581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:29.881972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:29.882452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:29.882887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:29.883572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:29.884031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:29.884449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:30.011317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:30.019480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9aff57f2-1658-4c94-9a55-102c3b38e36a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.148442 Aug 24 17:45:30.020048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 324/637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:29 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:30.516863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:45:30.517458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Wed Aug 24 17:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:45:31.041092 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:31.041729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:31.048255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:31.048775 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:31.049208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:31.049932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:31.050339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:31.050757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:31.177953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:31.186505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6b11933f-38ab-4bc8-819f-1d998d94219c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.149374 Aug 24 17:45:31.187057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 314/638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:31 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:32.208315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:32.208949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:32.215278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:32.215754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:32.216185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:32.216898 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:32.217349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:32.217768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:32.342735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:32.350786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-891904b8-5287-46d3-97a3-bdd0695de115 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.146322 Aug 24 17:45:32.351367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 325/639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:32 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:33.372941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:33.373555 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:33.380092 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:33.380597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:33.381041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:33.381726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:33.382183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:33.382608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:33.507682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:33.515947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8439708c-9c31-4733-a065-ee71fce50aa0 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.147494 Aug 24 17:45:33.516509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 315/640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:33 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:34.537549 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:34.538137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:34.544502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:34.545011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:34.545444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:34.546124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:34.546574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:34.546995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:34.910631 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:34.919734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c3c718ae-8b22-422e-b9ee-a6a1dbdd7a84 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.385577 Aug 24 17:45:34.920137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 326/641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:34 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:35.940664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:35.941268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:35.949339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:35.949820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:35.950249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:35.950936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:35.951385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:35.951803 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:36.076943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:36.085189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c0c01ea6-0aa5-4c03-a79c-aa185886ea48 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.148404 Aug 24 17:45:36.085750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 316/642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:35 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:37.107555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:37.108114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:37.114583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:37.115056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:37.115487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:37.116166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:37.116663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:37.117081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:37.243967 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:37.252745 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-415a5b18-fad9-486a-a752-1d1c7a317571 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.149084 Aug 24 17:45:37.253303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 327/643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:37 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:38.274397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:38.275124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:38.281744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=32 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:38.283844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:38.284385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:38.284842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:38.285563 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:38.286015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:38.286435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:38.290999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:38.412944 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:38.421034 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2a00d556-3a00-4fbb-8e3e-05e05d17aeec tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.150858 Aug 24 17:45:38.421591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 317/644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:38 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:39.442550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:39.443159 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:39.450009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:39.450481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:39.450913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:39.451593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:39.452048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:39.452462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:39.575600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:39.583748 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-40515e8f-fad5-479a-a7d9-21d56b882e8c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1735 microversion: 2.1 time: 0.145036 Aug 24 17:45:39.584310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 328/645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:39 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:40.605893 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:40.606496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:40.612837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.613314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.613741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:40.614420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.614869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.615287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:40.739631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:40.747687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bf27ccaf-e2a9-4dc2-9568-baba8884ecf6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1715 microversion: 2.1 time: 0.146268 Aug 24 17:45:40.748239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 318/646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:40 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1715 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:40.809945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:40.810584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:40.816444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.816945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.817371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:40.818046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.818490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.818903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:40.942950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] HTTP exception thrown: Cannot 'detach_volume' instance 424f0287-eef6-4fa1-95d1-d811e5199185 while it is in vm_state rescued Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Request method failure captured: Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments/1c501da7-8665-4ab0-a279-485a055fbae9 HTTP/1.1 Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKGZjtfUpqk-I7aBsLTwDoow31TFim1_lz_4bdzqcWhTXy8IslHKy-qrYaakTx9seATpW6aRGs0IqddNfLJmckT8DvuQw8Pl-pf6jx-z2nTsatY6zHjKdjMYdNMpjQfKQCzZ5E7_-Pm_zkWoY-Aoy1rKwiN-5C1VuhglFkWlZe95Bo Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:45:40.944576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 40c0367417434c04948e9f2a03e880a9 Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:45:40.946138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Cannot 'detach_volume' instance 424f0287-eef6-4fa1-95d1-d811e5199185 while it is in vm_state rescued Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'server_id': '424f0287-eef6-4fa1-95d1-d811e5199185', 'id': '1c501da7-8665-4ab0-a279-485a055fbae9'} Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:45:40.946955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 424f0287-eef6-4fa1-95d1-d811e5199185 while it is in vm_state rescued Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 424f0287-eef6-4fa1-95d1-d811e5199185 while it is in vm_state rescued Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:40.948982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Returning 409 to user: Cannot 'detach_volume' instance 424f0287-eef6-4fa1-95d1-d811e5199185 while it is in vm_state rescued {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:45:40.950128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-15a45374-7f56-45f2-9e6f-f0ae2196b51c tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments/1c501da7-8665-4ab0-a279-485a055fbae9" status: 409 len: 152 microversion: 2.1 time: 0.140080 Aug 24 17:45:40.950128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 329/647] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:45:40 2022] DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments/1c501da7-8665-4ab0-a279-485a055fbae9 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:45:40.955360 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:40.955916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:40.961672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.962145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.962574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:40.963895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:40.964344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:40.964789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:41.029500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-eb2bfa28-9e1d-4e1c-b39c-fdb9dd46d6a1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/action" status: 202 len: 0 microversion: 2.1 time: 0.077790 Aug 24 17:45:41.033093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 319/648] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:45:40 2022] POST /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:45:41.038332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:41.039031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:41.046236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:41.046730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:41.047169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:41.047868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:41.048324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:41.048788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:41.266175 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:41.274818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8de9177b-40a1-4c76-b054-97648fceaa06 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1723 microversion: 2.1 time: 0.240358 Aug 24 17:45:41.275378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 330/649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:41 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:42.298330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:42.299028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:42.305085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:42.305563 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:42.306001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:42.306684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:42.307136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:42.307558 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:42.432128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:42.440186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c6ff0bad-0556-4b78-b377-f82cc55305ac tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1723 microversion: 2.1 time: 0.146600 Aug 24 17:45:42.440843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 320/650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:42 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:43.460978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:43.461586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:43.464608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=38 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:43.469785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:43.470263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:43.470693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:43.471375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:43.471826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:43.472243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:43.601031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:43.609431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ffc24451-480b-45c0-a589-bc7f853a7422 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1723 microversion: 2.1 time: 0.152142 Aug 24 17:45:43.609992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 331/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:43 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:44.631297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:44.631867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:44.638294 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:44.638777 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:44.639217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:44.639907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:44.640365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:44.640826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:44.765688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:44.774319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-72cc17f1-90d8-4768-8525-d5bd8d2be2c1 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1723 microversion: 2.1 time: 0.146670 Aug 24 17:45:44.774891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 321/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:44 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:45.795282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:45.795886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:45.802370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:45.802841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:45.803275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:45.803950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:45.804390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:45.804826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:45.933387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:45.941377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b818ab5b-13ab-45f8-a7be-f261f723ac95 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1729 microversion: 2.1 time: 0.149968 Aug 24 17:45:45.941926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 332/653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:45 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:45.962166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:45.962695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:45.968991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:45.969466 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:45.969901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:45.970607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:45.971061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:45.971484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:46.047688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-73294394-32c4-47e2-b414-f614ef0fd9a6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089277 Aug 24 17:45:46.048278 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 322/654] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:45:45 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:46.884194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:46.894028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:46.894500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:46.894919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:46.907085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] Creating event network-changed:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:45:46.912618 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-7bbffcb3-3e6e-4d87-8e4d-94432754f11c req-5ceef34c-e926-4ebf-a41d-c5c4ea3e4f17 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031696 Aug 24 17:45:46.913573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 333/655] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:48.927120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:48.936859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:48.937327 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:48.937982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:48.949593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] Creating event network-changed:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:45:48.954896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-e0bd15ca-001c-4332-9eb1-1edd6fa59e78 req-4c967cb8-f4d7-419d-a235-a01036f01c7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031741 Aug 24 17:45:48.955462 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 323/656] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:53.085233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:53.085805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:53.092490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:53.092994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:53.093419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:53.094092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:53.094538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:53.094951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:53.098853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=97 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:53.119177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:45:53.191760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-39137723-773c-4d8a-a89b-e8b1fc5dfc4a tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 204 len: 0 microversion: 2.1 time: 0.111078 Aug 24 17:45:53.192344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 334/657] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:45:53 2022] DELETE /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:45:53.201636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:53.202328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:53.208955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:53.209433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:53.209866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:53.210546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:53.211186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:53.211631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:53.347833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:53.355599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1dadbfe7-8bb7-4138-8409-b97919e63b7f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1577 microversion: 2.1 time: 0.158674 Aug 24 17:45:53.356162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 324/658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:53 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:54.377083 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:54.377778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:54.384170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:54.384624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:54.385063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:54.386355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:54.386807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:54.387228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:54.524681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:54.532279 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bd5c2c32-1e7c-4435-9d86-4190af3aafd0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1577 microversion: 2.1 time: 0.159531 Aug 24 17:45:54.532870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 335/659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:54 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:55.553883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:55.554532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:55.561477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:55.561960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:55.562395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:55.563081 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:55.563534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:55.563955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:55.794961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:55.804535 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-10922ce3-d813-42af-a90a-8c0bb61ea0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1577 microversion: 2.1 time: 0.254467 Aug 24 17:45:55.805136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 325/660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:55 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1577 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:56.545434 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5b60a1-b2cb-4bbd-b257-0389ddd4018d", "name": "network-vif-deleted", "tag": "97c9e402-e829-42c1-bfa7-cd80ccab0f40"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:56.555008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:56.555487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:56.555909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:56.567100 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] Creating event network-vif-deleted:97c9e402-e829-42c1-bfa7-cd80ccab0f40 for instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d on hv-cinder-83538 Aug 24 17:45:56.571889 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-17209ac9-9280-4fa7-9477-4d93babd2597 req-d59d63be-7cac-4e8a-9373-dede8cba6684 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105237 Aug 24 17:45:56.572616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 336/661] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:56.827246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:56.828656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:56.837934 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:56.839310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:56.840086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:56.840681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:56.841274 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:56.841520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:56.876125 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:56.876876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:56.877460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:56.878054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lazy-loading 'fault' on Instance uuid 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:45:56.928028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:56.936362 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d28f48b3-f504-4842-b439-b9942e79e6e3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 200 len: 1230 microversion: 2.1 time: 0.114007 Aug 24 17:45:56.936965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 326/662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:56 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:57.960499 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:57.961236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:57.968068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:57.968540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:57.968998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:57.969672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:57.970546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:57.970979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:57.984233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] HTTP exception thrown: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Request method failure captured: Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d HTTP/1.1 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmK92RJo5QalArxHXh9tcrgu6mK_xWO6hE2i6n_e2UkQqii-zQ9bmMd7z_Sks1nNeCAglIwKcmMI49m_e7SwGhh7sYky4ROt8kt3JTBILYKRK8L3CgxO9KvPy9ug8UeragU2c2-pxHTguUL9sQu7cl2HFCClf839FHb_P9QSpphdwW8 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:45:57.985838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: af6710bfe62d4ba29dc48e2f7aba9ec5 Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:45:57.987364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '1b5b60a1-b2cb-4bbd-b257-0389ddd4018d'} Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:45:57.988353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:45:57.989588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:45:57.990694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Returning 404 to user: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:45:57.990694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e760c856-d358-4fa7-a960-aa29d86d8b3d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 404 len: 111 microversion: 2.1 time: 0.031722 Aug 24 17:45:57.990694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 337/663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:57 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:45:58.082520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973312136", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1534415720", "security_groups": [{"name": "tempest-secgroup-smoke-1199944032"}], "block_device_mapping_v2": [{"uuid": "60180b4c-f12c-44be-8beb-df94cedf203c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4271adb9-59ee-439b-8826-7fda036d50f7"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:45:58.200392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] validate_networks() for [('4271adb9-59ee-439b-8826-7fda036d50f7', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:45:58.612920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:45:58.613346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:45:58.613842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:45:58.614251 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:45:58.614661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:45:58.623843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:58.624325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:58.624795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:58.625527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:58.625984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:58.626416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:58.643498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:45:58.647495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for user af6710bfe62d4ba29dc48e2f7aba9ec5 and project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:45:58.703818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:45:58.705972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60180b4c-f12c-44be-8beb-df94cedf203c',volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:45:58.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ca6fc02d-3a75-45a2-8ade-2056a63c2635 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759777 Aug 24 17:45:58.838872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 327/664] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:45:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:45:58.849584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d4af43b5-a2a0-4368-a155-6db6f0c3a805 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:58.850188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d4af43b5-a2a0-4368-a155-6db6f0c3a805 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:58.905135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d4af43b5-a2a0-4368-a155-6db6f0c3a805 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:45:58.912544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d4af43b5-a2a0-4368-a155-6db6f0c3a805 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1095 microversion: 2.1 time: 0.066771 Aug 24 17:45:58.913135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 338/665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:58 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:59.933194 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:59.933811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:45:59.941422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:59.941911 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:59.942344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:59.943040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:59.943494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:59.943917 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:00.015607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:00.025061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9235e850-a308-4cef-985c-c9de5727e0bd tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1201 microversion: 2.1 time: 0.095427 Aug 24 17:46:00.025640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 328/666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:45:59 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:01.045840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:01.046563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:01.054529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:01.055016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:01.055455 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:01.056146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:01.056623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:01.057627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:01.274601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:01.282520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-814760d7-bcec-4b85-acc4-ed3ab8481268 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.240648 Aug 24 17:46:01.283080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 339/667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:01 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:01.348785 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918", "tag": "efd5908f-b087-4c34-9623-0c8761406440"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:01.364795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:01.365279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:01.365704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:01.377221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] Creating event network-changed:efd5908f-b087-4c34-9623-0c8761406440 for instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 on hv-cinder-83538 Aug 24 17:46:01.382014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-b0ea63fc-522c-46eb-bdab-8f6deccbea79 req-e55d4a78-f547-4e57-ace7-191177368f16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036960 Aug 24 17:46:01.382633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 329/668] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:02.303185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:02.303782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:02.310173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:02.310646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:02.311080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:02.311759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:02.312211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:02.312655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:02.440028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:02.447519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-da90da9e-6f75-4216-8009-a18c1b535265 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.148224 Aug 24 17:46:02.448625 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 340/669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:02 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:03.468986 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:03.469709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:03.475763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:03.476240 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:03.476706 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:03.477392 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:03.477845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:03.478268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:03.610249 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:03.617878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9c06cd03-3994-4b63-b928-b9f79232b7af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.153658 Aug 24 17:46:03.618445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 330/670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:03 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:04.638079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:04.638688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:04.644988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:04.645461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:04.645891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:04.646568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:04.647016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:04.647434 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:04.773736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:04.781775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9686cc0e-0379-4838-ace3-1a557706b0d0 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.147523 Aug 24 17:46:04.782339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 341/671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:04 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:05.802230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:05.802849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:05.809817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:05.810293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:05.810723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:05.811408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:05.811860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:05.812278 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:05.938519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:05.946111 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-31493100-23ca-480d-bed7-a87fdd0959ca tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.147775 Aug 24 17:46:05.946672 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 331/672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:05 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:06.966938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:06.967545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:06.979843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:06.980819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:06.981252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:06.981938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:06.982385 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:06.982802 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:07.115343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:07.122900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-92b81891-7b13-4b22-951d-bc4b2700e0a9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.160397 Aug 24 17:46:07.123464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 342/673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:06 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:08.143534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:08.144129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:08.151615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:08.152091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:08.152522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:08.153234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:08.153686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:08.154108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:08.283997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:08.292461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b647ec43-c443-47ab-9c85-f555a070ca71 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.152181 Aug 24 17:46:08.293065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 332/674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:08 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:09.313747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:09.314354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:09.316848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:09.322099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:09.322575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:09.323010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:09.323696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:09.324144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:09.324579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:09.457221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:09.465428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-04dd8c02-6452-425e-b18c-32b56b6253fe tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.155550 Aug 24 17:46:09.465986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 343/675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:09 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:10.486554 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:10.487164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:10.489122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:10.489784 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:10.491040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:10.497906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:10.498673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:10.499113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:10.499807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:10.500258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:10.500712 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:10.505550 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:10.636331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:10.643961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9dc544c6-2e89-46c1-8655-07c8877d77d7 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.161424 Aug 24 17:46:10.644542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 333/676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:10 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:11.664642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:11.665247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:11.671782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:11.672258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:11.672737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:11.673421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:11.673865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:11.674279 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:11.814870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:11.822758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e65556b0-a7cd-4f26-a521-df7a1116f3f8 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.161886 Aug 24 17:46:11.823868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 344/677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:11 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:11.894289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918", "name": "network-vif-plugged", "status": "completed", "tag": "efd5908f-b087-4c34-9623-0c8761406440"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:11.905096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:11.905578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:11.906006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:11.916844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] Creating event network-vif-plugged:efd5908f-b087-4c34-9623-0c8761406440 for instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 on hv-cinder-83538 Aug 24 17:46:11.921741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-3bb1bbc3-3369-4fb9-a2f6-4eb4cc0020f9 req-8b031b94-8b0e-4010-baba-9b4542aa2074 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088231 Aug 24 17:46:11.922332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 334/678] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:46:12.844523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:12.845153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:12.851149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:12.851621 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:12.852045 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:12.852758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:12.853206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:12.853623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:12.979939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:12.987986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9ae7bc2e-7675-4824-be93-c14e68163c3b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.147295 Aug 24 17:46:12.988564 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 345/679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:12 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:14.008741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:14.009434 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:14.016855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:14.017337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:14.017774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:14.018459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:14.018910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:14.019334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:14.150599 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:14.158538 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a769e874-a692-4221-b0ed-be00921b1406 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1267 microversion: 2.1 time: 0.153981 Aug 24 17:46:14.159124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 335/680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:14 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:15.178843 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:15.179455 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:15.181864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:15.186992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:15.187474 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:15.187903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:15.188609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:15.189092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:15.189509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:15.317075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:15.325230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-93510fe5-cf4e-4ba2-9ae6-ded6672d039f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1454 microversion: 2.1 time: 0.150298 Aug 24 17:46:15.325789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 346/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:15 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:15.345404 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:15.346013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:15.352269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:15.352782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:15.353216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:15.353905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:15.354359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:15.354781 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:15.485595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:15.493220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-99914a51-d51f-4a76-944f-db5003d6638b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1454 microversion: 2.1 time: 0.151592 Aug 24 17:46:15.493778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 336/682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:15 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:17.251219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918", "tag": "efd5908f-b087-4c34-9623-0c8761406440"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:17.261079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:17.261592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:17.262021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:17.274089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] Creating event network-changed:efd5908f-b087-4c34-9623-0c8761406440 for instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 on hv-cinder-83538 Aug 24 17:46:17.279985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-d86bf8f2-be4e-4d09-8afd-5007198a65da req-314cee66-95f7-40f1-aa1f-18af8e91188c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032460 Aug 24 17:46:17.280841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 347/683] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:23.017715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:23.018215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:23.024104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.024644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.025094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.026055 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.026512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.026940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.050220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-82adbb91-8fec-441a-89e8-208409d86cad tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/ips" status: 200 len: 150 microversion: 2.1 time: 0.087459 Aug 24 17:46:23.050974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 337/684] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:46:22 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:23.065535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6031ce6-5164-4248-833e-c1ebeb9129cd"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:23.067903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:23.073866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.075016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.075443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.076163 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.076635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.077052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.151749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:23.157904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: POST /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/os-volume_attachments HTTP/1.1 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 74 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:46:23.159586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {"volumeAttachment": {"volumeId": "b6031ce6-5164-4248-833e-c1ebeb9129cd"}} Aug 24 17:46:23.161298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'server_id': '50e5570a-2379-45a8-935b-116885887681', 'body': {'volumeAttachment': {'volumeId': 'b6031ce6-5164-4248-833e-c1ebeb9129cd'}}} Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:23.162109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:23.163725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 400 to user: Invalid volume: volume b6031ce6-5164-4248-833e-c1ebeb9129cd is already attached to instances: db27e2e1-eafc-4042-ac32-131c956b188e {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1adb9a1d-3826-4031-8487-e550784d3f11 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100759 Aug 24 17:46:23.165243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 348/685] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:46:23 2022] POST /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:46:23.170941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:23.171437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:23.177382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.177863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.178295 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.178989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.179440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.179866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.206014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:46:23.286639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2b08bd8d-306d-4ae7-a902-5050caa053c1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 204 len: 0 microversion: 2.1 time: 0.119347 Aug 24 17:46:23.289741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 338/686] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:46:23 2022] DELETE /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:46:23.297406 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:23.298540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:23.306294 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.306774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.307212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.307903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:23.308354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:23.309313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:23.439753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:23.447370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e570b4d0-58ea-4c6d-b53d-0946177a64fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1680 microversion: 2.1 time: 0.155581 Aug 24 17:46:23.447932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 349/687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:23 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:24.468870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:24.469562 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:24.475787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:24.476260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:24.476730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:24.477412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:24.477857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:24.479088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:24.612347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:24.620037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e50047a9-c1b1-4af3-a2b7-7be90a12d63a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1680 microversion: 2.1 time: 0.155444 Aug 24 17:46:24.620627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 339/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:24 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:25.641726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:25.642337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:25.648910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:25.649395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:25.649830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:25.650527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:25.651242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:25.651669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:25.895226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:25.904284 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9fce9974-755a-4cd5-b8af-0cd7df97424d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 200 len: 1680 microversion: 2.1 time: 0.266430 Aug 24 17:46:25.905365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 350/689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:25 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:26.099452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e5570a-2379-45a8-935b-116885887681", "name": "network-vif-deleted", "tag": "2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:26.109757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:26.110291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:26.110678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:26.123183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] Creating event network-vif-deleted:2ef9a6e8-1ee4-45b8-b1df-158a0ebf6e91 for instance 50e5570a-2379-45a8-935b-116885887681 on hv-cinder-83538 Aug 24 17:46:26.128528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-ca5fa1b0-b43d-4283-ae55-aec35d9f1735 req-82c354e3-a5ed-46b0-a2c3-01bdcbc10478 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Aug 24 17:46:26.129343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 340/690] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:26.925470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:26.926732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:26.933266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:26.933753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:26.934188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:26.934890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:26.935387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:26.935983 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:26.949875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 HTTP/1.1 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:46:26.951408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:46:26.952923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '50e5570a-2379-45a8-935b-116885887681'} Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:46:26.953762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:46:26.955110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:26.956395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:46:26.956395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4a5491de-95c0-4dfd-844e-fdddd067ee63 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 24 17:46:26.956395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 351/691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:26 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:26.962175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e1af1d95-d5de-4e82-a95a-5b6c23be2edb tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '.version_select at 0x7fa666cfddc0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:26.983530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e1af1d95-d5de-4e82-a95a-5b6c23be2edb tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39669028" status: 202 len: 0 microversion: 2.1 time: 0.025408 Aug 24 17:46:26.984106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 341/692] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 24 17:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39669028 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:46:27.695354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:27.695845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:27.702596 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:27.703075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:27.703501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:27.704180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:27.704660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:27.705080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:27.789011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lazy-loading 'services' on Instance uuid db27e2e1-eafc-4042-ac32-131c956b188e {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:46:27.899338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d41bfb61-e0ff-49b4-a960-04d005f7e8ef tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments/b6031ce6-5164-4248-833e-c1ebeb9129cd" status: 202 len: 0 microversion: 2.1 time: 0.207728 Aug 24 17:46:27.899914 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 352/693] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:46:27 2022] DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments/b6031ce6-5164-4248-833e-c1ebeb9129cd => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:46:27.909060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:27.911401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:27.920653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:27.921142 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:27.921588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:27.922321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:27.922750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:27.923168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:27.952315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ac11418d-7794-43b9-976a-004a9128bbca tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047609 Aug 24 17:46:27.952899 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 342/694] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:46:27 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:28.965285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:28.967594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:28.973733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:28.974206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:28.974638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:28.975319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:28.975772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:28.976192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:29.004758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-457bc67d-5780-4995-a0da-7cf924e9c6b9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044252 Aug 24 17:46:29.005302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 353/695] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:46:28 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:46:29.067072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:29.067603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:29.073499 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:29.073982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:29.074973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:29.075657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:29.076110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:29.076542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:29.100484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:46:29.174896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ea985f49-bd7b-4d1e-aa0a-5c6b946945f4 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 204 len: 0 microversion: 2.1 time: 0.111493 Aug 24 17:46:29.175471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 343/696] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:46:29 2022] DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:46:29.185235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:29.185917 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:29.191817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:29.192286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:29.192750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:29.193431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:29.193874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:29.194289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:29.320742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:29.328895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eaa3d266-9215-4c53-aa44-89b7b37bf354 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1681 microversion: 2.1 time: 0.148096 Aug 24 17:46:29.329457 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 354/697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:29 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:30.350620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:30.351312 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:30.357612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:30.358088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:30.358518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:30.359197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:30.359645 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:30.360064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:30.489816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:30.497991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-eb6c3840-4602-4ab1-adf0-d22a4434f0d9 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1681 microversion: 2.1 time: 0.151659 Aug 24 17:46:30.498565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 344/698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:30 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:31.519600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:31.520231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:31.526962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:31.527582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:31.528508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:31.529268 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:31.529717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:31.530135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:31.557285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db27e2e1-eafc-4042-ac32-131c956b188e", "name": "network-vif-deleted", "tag": "72dcd75d-031e-4de4-95ca-13504315365d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:31.571709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:31.572450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:31.573018 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:31.585941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] Creating event network-vif-deleted:72dcd75d-031e-4de4-95ca-13504315365d for instance db27e2e1-eafc-4042-ac32-131c956b188e on hv-cinder-83538 Aug 24 17:46:31.592212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-77d3b5f2-f949-4eb7-a971-570d6ec4e246 req-de964a05-b1b8-4146-88a1-a56f852d02ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045799 Aug 24 17:46:31.593532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 345/699] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:31.607609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:31.623966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6883728b-5939-4177-bd55-896c010b9668 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 200 len: 1614 microversion: 2.1 time: 0.108433 Aug 24 17:46:31.632596 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 355/700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:31 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:32.648010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:32.648809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:32.655209 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:32.655683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:32.656112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:32.656822 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:32.657269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:32.657687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:32.670955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e HTTP/1.1 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:46:32.672584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:46:32.674080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'db27e2e1-eafc-4042-ac32-131c956b188e'} Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:46:32.674903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:46:32.676067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:46:32.677175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:46:32.677175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-67b4408e-c3b5-4592-a98f-1ef13e3c3366 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 404 len: 111 microversion: 2.1 time: 0.030718 Aug 24 17:46:32.677175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 346/701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:32 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:46:32.682779 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1a614018-3503-454f-a3f3-0552284e8531 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '.version_select at 0x7fa66d4fc430>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:32.702771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1a614018-3503-454f-a3f3-0552284e8531 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412886604" status: 202 len: 0 microversion: 2.1 time: 0.023857 Aug 24 17:46:32.703327 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 356/702] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 24 17:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412886604 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:46:33.320916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d4392b1d-846c-4eda-906e-7e22e2112974 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: .version_select at 0x7fa666c68280>, body: {"keypair": {"name": "tempest-keypair-458700153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrL5z3+YUZSvss2wAB701gCJdwrVfBRW0givTpJs39UooF0J7AxfGWRMR5Pyj3eSDrJM1vecCHFgpO2anDpDb6YTxi0NFaaA8Do1W7K9A2oVZ0Bx6rapyn6W9+9PAGfkg=="}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:33.336372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-d4392b1d-846c-4eda-906e-7e22e2112974 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:46:33.340079 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-d4392b1d-846c-4eda-906e-7e22e2112974 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:46:33.361285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d4392b1d-846c-4eda-906e-7e22e2112974 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044342 Aug 24 17:46:33.361847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 347/703] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:46:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:34.545092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-257284239", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1229ac7-2636-42fd-bd13-5a97e33445e1"}], "security_groups": [{"name": "tempest-securitygroup--782558090"}], "key_name": "tempest-keypair-458700153", "user_data": "}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:34.644411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] validate_networks() for [('b1229ac7-2636-42fd-bd13-5a97e33445e1', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:46:35.047666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:46:35.048191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:46:35.048712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:46:35.049151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:46:35.049560 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:46:35.058346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:35.058826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:35.059793 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:35.060515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:35.060988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:35.061415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:35.078185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:46:35.082081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:46:35.093434 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:46:35.095714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:46:35.141597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-98af7359-ab09-4535-a17d-3b453dea4447 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601812 Aug 24 17:46:35.142237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 357/704] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:46:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:46:35.154489 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ff83d553-d4ee-4e71-ad6e-c6f9c87f7964 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:35.155088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ff83d553-d4ee-4e71-ad6e-c6f9c87f7964 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:35.208727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ff83d553-d4ee-4e71-ad6e-c6f9c87f7964 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:35.215833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ff83d553-d4ee-4e71-ad6e-c6f9c87f7964 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1240 microversion: 2.1 time: 0.065957 Aug 24 17:46:35.217454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 348/705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:35 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:46:36.236902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:36.237871 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:36.244024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:36.244498 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:36.244968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:36.245661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:36.246105 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:36.247218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:36.309601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:36.317225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-33cfad2e-bf20-4a0a-b344-203900414d82 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1298 microversion: 2.1 time: 0.084731 Aug 24 17:46:36.317789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 358/706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:36 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:37.338458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:37.339214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:37.346389 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:37.346873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:37.347311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:37.348044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:37.348493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:37.348936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:37.550940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320e715c-be02-44d4-a40c-e19d2b9356db", "tag": "ce909ca4-c2d4-49af-b3d8-fa097b532e08"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:37.561986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:37.562556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:37.563052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:37.573345 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:37.575054 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] Creating event network-changed:ce909ca4-c2d4-49af-b3d8-fa097b532e08 for instance 320e715c-be02-44d4-a40c-e19d2b9356db on hv-cinder-83538 Aug 24 17:46:37.581255 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-5c19bc0e-6c4f-4331-b3fd-7a6ad60d6b73 req-9992f445-0481-4ff8-91dd-20cf00c46087 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 Aug 24 17:46:37.581893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 359/707] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:46:37.582343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-852c07e8-8fb7-42a9-9fcb-dd4b288638f2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.247738 Aug 24 17:46:37.582914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 349/708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:37 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:38.604133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:38.604726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:38.610711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:38.611182 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:38.611605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:38.612283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:38.612757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:38.613168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:38.738358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:38.745862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1cabbc7c-1e4d-49f7-baa4-4be713f25fe0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.146509 Aug 24 17:46:38.746923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 360/709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:38 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:39.767216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:39.768149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:39.774999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:39.775483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:39.775916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:39.776940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:39.777390 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:39.778341 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:39.910683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:39.918202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d745ed44-339b-4f04-86ee-54b4bdc808f0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.154914 Aug 24 17:46:39.918758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 350/710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:39 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:40.939995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:40.940620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:40.946971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:40.947445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:40.947874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:40.948574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:40.949022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:40.949439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:41.109619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:41.117192 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e23c3c9a-5415-4805-af8f-3d26a88d00e7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.181247 Aug 24 17:46:41.117751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 361/711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:40 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:42.138484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:42.139003 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:42.141429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:42.146842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:42.147315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:42.147744 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:42.148424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:42.148896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:42.149314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:42.153174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:42.282940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:42.290420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7c201e34-5a2b-4728-8ca4-146365a008ce tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.156007 Aug 24 17:46:42.290972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 351/712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:42 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:43.312102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:43.312777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:43.318704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:43.319179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:43.319612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:43.320300 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:43.320786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:43.321209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:43.446850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:43.454998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5e650b29-cc99-49cd-837c-2c10e5e9c78c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.147421 Aug 24 17:46:43.455562 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 362/713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:43 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:43.960840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e715c-be02-44d4-a40c-e19d2b9356db", "name": "network-vif-plugged", "status": "completed", "tag": "ce909ca4-c2d4-49af-b3d8-fa097b532e08"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:43.972408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:43.972925 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:43.973468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:43.985201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] Creating event network-vif-plugged:ce909ca4-c2d4-49af-b3d8-fa097b532e08 for instance 320e715c-be02-44d4-a40c-e19d2b9356db on hv-cinder-83538 Aug 24 17:46:43.990045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-6b409a1e-ccc6-4352-871b-8b986779e0bf req-7f3a2702-6068-44c6-a794-f3dcb0cacfd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033689 Aug 24 17:46:43.990623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 352/714] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:44.475514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:44.476128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:44.482542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:44.483023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:44.483456 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:44.484140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:44.484612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:44.485037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:44.615760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:44.623452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-54cdd123-bc05-45a3-a94b-38ea5fe7091e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.151749 Aug 24 17:46:44.624091 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 363/715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:44 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:45.642236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:45.646564 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:45.647261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:45.654449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:45.654927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:45.655363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:45.656049 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:45.656505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:45.656954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:45.791456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:45.800369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c94c9545-00c7-4179-a5aa-7abd419bfc4d tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1365 microversion: 2.1 time: 0.159440 Aug 24 17:46:45.801552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 353/716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:45 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:45.952138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:45.952902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=6 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:46.050155 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:46.050652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:46.052494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:46.057904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.058381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.058819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.059508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.059988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.060406 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.089837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e436288e-292a-4dff-adde-8d57d36608a9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments/c056486c-f484-4f7f-a6d0-0b7542126879" status: 200 len: 194 microversion: 2.20 time: 0.142798 Aug 24 17:46:46.091101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 364/717] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Aug 24 17:46:45 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments/c056486c-f484-4f7f-a6d0-0b7542126879 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:46:46.159475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:46.159965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:46.166120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.166600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.167341 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.168536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.169119 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.169690 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.293214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lazy-loading 'services' on Instance uuid 31b745f4-f69f-4b83-a066-cadcb0a95389 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:46:46.406500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-63a74b32-1ac3-4dca-b890-f2186a67259d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments/c056486c-f484-4f7f-a6d0-0b7542126879" status: 202 len: 0 microversion: 2.20 time: 0.250877 Aug 24 17:46:46.407193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 354/718] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 24 17:46:46 2022] DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments/c056486c-f484-4f7f-a6d0-0b7542126879 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:46:46.415586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:46.417882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:46.424165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.424693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.425124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.425816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.426264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.426687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.457437 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7ab63f3a-7e1a-451f-a550-fdf601bd7a9d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045785 Aug 24 17:46:46.457996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 365/719] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 17:46:46 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:46:46.821527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:46.822231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:46.828495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.829012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.829450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.830139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.830601 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.831029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.959346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:46.967684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-779f1cc0-90a7-448c-8e21-948f86c5b096 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1555 microversion: 2.1 time: 0.150995 Aug 24 17:46:46.968259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 355/720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:46 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:46.989035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:46.989582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:46.995858 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.996338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.996833 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:46.997535 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:46.997990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:46.998402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.075722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3c1106cb-d3dd-4aea-83d9-e1c16daed4b0 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090507 Aug 24 17:46:47.077021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 366/721] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:46:46 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:47.470810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:47.473321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:47.479300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.479783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.480225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.480950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.481403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.481828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.510636 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-05905bf0-085d-4adf-9935-89d5108a899c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043839 Aug 24 17:46:47.511208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 356/722] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 17:46:47 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:47.574436 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:47.575471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:47.581430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.581900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.582323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.582998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.583440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.583854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.610019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:46:47.623203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:47.694291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f0128027-b24d-4939-9633-0427112df63a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 204 len: 0 microversion: 2.20 time: 0.123633 Aug 24 17:46:47.698301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 367/723] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 17:46:47 2022] DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:46:47.704231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:47.704868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:47.710967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.711460 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.711921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:47.712648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:47.713098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:47.713520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:48.051701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:48.060351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:48.061888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:48.063045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c3acae3d-c25f-4fc3-a944-fa7fa338029a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.363593 Aug 24 17:46:48.063602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 357/724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:47 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:46:48.322430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320e715c-be02-44d4-a40c-e19d2b9356db", "tag": "ce909ca4-c2d4-49af-b3d8-fa097b532e08"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:48.332085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:48.332591 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:48.333011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:48.344690 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] Creating event network-changed:ce909ca4-c2d4-49af-b3d8-fa097b532e08 for instance 320e715c-be02-44d4-a40c-e19d2b9356db on hv-cinder-83538 Aug 24 17:46:48.349713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a0fcaeed-c32b-4009-a5b4-c950532bc403 req-09dad32c-cdef-48f0-932f-f2da62bf7c1c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031181 Aug 24 17:46:48.350502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 368/725] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:49.085813 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:49.086444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:49.093098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:49.093587 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:49.094656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:49.095374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:49.095827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:49.096422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:49.250058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:49.259265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:49.260809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:49.261982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dbda9ed3-00ec-45e0-95a2-f5d657e0441f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1723 microversion: 2.20 time: 0.180082 Aug 24 17:46:49.262863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 358/726] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:49 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:50.287271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:50.287959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:50.294584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:50.295053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:50.295477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:50.296153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:50.296622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:50.297040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:50.368531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:50.377004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:50.378495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:50.379636 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a83e2a38-b372-4ad8-ada4-74e297717a4d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 200 len: 1656 microversion: 2.20 time: 0.097299 Aug 24 17:46:50.380212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 369/727] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:50 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:50.450164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b745f4-f69f-4b83-a066-cadcb0a95389", "name": "network-vif-deleted", "tag": "bd404ada-17b6-41ec-b9c0-841e2a855608"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:50.460887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:50.461372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:50.461983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:50.474399 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] Creating event network-vif-deleted:bd404ada-17b6-41ec-b9c0-841e2a855608 for instance 31b745f4-f69f-4b83-a066-cadcb0a95389 on hv-cinder-83538 Aug 24 17:46:50.479334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-81257152-5d1b-4b6c-b435-5806cc54e05e req-039c0193-984f-4ec2-84c3-57e6012de359 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Aug 24 17:46:50.479939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 359/728] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:51.403064 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:51.403835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:51.410724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:51.411335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:51.411897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:51.412818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:51.413277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:51.413714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:51.427859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 HTTP/1.1 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:46:51.429540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:46:51.431269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '31b745f4-f69f-4b83-a066-cadcb0a95389'} Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:46:51.432213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:46:51.434641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:46:51.436201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:46:51.436201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-552f3be9-96aa-4982-a180-05052cb71a2b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 404 len: 111 microversion: 2.20 time: 0.032148 Aug 24 17:46:51.436201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 370/729] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:51 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:46:51.440898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f70c4b47-c106-45b5-866f-47e744d21ab9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '.version_select at 0x7fa666c609d0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:51.459382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f70c4b47-c106-45b5-866f-47e744d21ab9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264336043" status: 204 len: 0 microversion: 2.20 time: 0.022619 Aug 24 17:46:51.460086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 360/730] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 24 17:46:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264336043 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:46:52.075668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-312270cb-c09c-4813-828f-06279db3ebff tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: .version_select at 0x7fa666d09af0>, body: {"keypair": {"name": "tempest-keypair-138125811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYu0+IvTe5qhN2bIavSuzq3rADuitiLBlGsRVDdqAbexhAeRfSjLse6glqx9VdGz3TgUkXaGOgavMGokZ4PFsLo5bEKbSVPx0VA8YxX61CNVYYCRAjexwWl3N4HSLrBrw=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:52.091169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-312270cb-c09c-4813-828f-06279db3ebff tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for project 761d3524ec174bcb8f207cff3728bcea. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:46:52.095640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-312270cb-c09c-4813-828f-06279db3ebff tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for user 892dad01ea684e6cb2d5cec659c6c4b9 and project 761d3524ec174bcb8f207cff3728bcea. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:46:52.116743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-312270cb-c09c-4813-828f-06279db3ebff tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044947 Aug 24 17:46:52.117265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 371/731] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 24 17:46:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:46:53.305487 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2111634010", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c112f9b2-f4e4-4b01-8e76-6fe4d4495e59"}], "security_groups": [{"name": "tempest-securitygroup--1917545029"}], "key_name": "tempest-keypair-138125811", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:46:53.399929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:53.400483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:53.408024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.408507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.409025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.409452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] validate_networks() for [('c112f9b2-f4e4-4b01-8e76-6fe4d4495e59', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:46:53.409665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.410119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.410546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.491396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lazy-loading 'services' on Instance uuid 424f0287-eef6-4fa1-95d1-d811e5199185 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:46:53.564279 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8d11e8d1-4b71-4120-8d16-950d136bd32b tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments/1c501da7-8665-4ab0-a279-485a055fbae9" status: 202 len: 0 microversion: 2.1 time: 0.168708 Aug 24 17:46:53.565144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 372/732] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:46:53 2022] DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments/1c501da7-8665-4ab0-a279-485a055fbae9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:46:53.574329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:53.577221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:53.583466 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.583947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.584416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.585195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.585659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.586084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.623652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b408be55-da4e-4312-ad28-236becc5d9b6 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053733 Aug 24 17:46:53.624040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 373/733] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:46:53 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:46:53.789650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:46:53.790071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:46:53.790557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:46:53.790941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:46:53.791348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:46:53.800248 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.800798 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.801226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.801941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:53.802386 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:53.802802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:53.819826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for project 761d3524ec174bcb8f207cff3728bcea. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:46:53.823689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Getting quotas for user 892dad01ea684e6cb2d5cec659c6c4b9 and project 761d3524ec174bcb8f207cff3728bcea. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:46:53.835060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:46:53.837668 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:46:53.883875 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3e40296d-e90c-4931-a666-0938dd76be92 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.583160 Aug 24 17:46:53.884518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 361/734] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 24 17:46:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:46:53.895705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:53.896309 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:53.957584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:53.967526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:53.969133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:53.970419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6b31c97a-0e1d-416e-ad4d-96dd136a298b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1281 microversion: 2.20 time: 0.078492 Aug 24 17:46:53.971344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 374/735] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:53 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:54.635553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:54.637736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:54.644497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.645013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.645443 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.646126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.646580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.647006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.678312 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-22cb1cc5-f909-42ba-bc01-57ad7ab207c8 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046927 Aug 24 17:46:54.678858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 362/736] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:46:54 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:46:54.749496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:54.750053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:54.757450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.757934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.758372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.759065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.759520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.759938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.786507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:46:54.869462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-23341673-ff3a-457b-b271-ef1c9bd8a723 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 204 len: 0 microversion: 2.1 time: 0.123113 Aug 24 17:46:54.870380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 375/737] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:46:54 2022] DELETE /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:46:54.878563 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:54.879201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:54.887286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.887699 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.888133 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.889399 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.889900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:54.890513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:54.992608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:54.993329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:54.999252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:54.999820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:55.000314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:55.001090 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:55.001603 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:55.002085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:55.052698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:55.060346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-87439690-ea7e-43b0-96ad-37acdcebfcba tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1689 microversion: 2.1 time: 0.185606 Aug 24 17:46:55.060938 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 363/738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:54 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:55.068984 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:55.077647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:55.079129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:55.080213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-156cc6b1-6ce7-49f4-910e-a9f740a18417 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1351 microversion: 2.20 time: 0.092083 Aug 24 17:46:55.080814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 376/739] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:54 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:46:56.080759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:56.081313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:56.087726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:56.088210 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:56.088678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:56.089370 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:56.089828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:56.090258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:56.103066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:56.103667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:56.110734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:56.111206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:56.111641 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:56.112321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:56.112792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:56.113205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:56.186053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:56.194198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:56.195692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:56.196803 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e25537f9-3961-48c1-8c92-0c17e44268d1 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1351 microversion: 2.20 time: 0.097527 Aug 24 17:46:56.197355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 377/740] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:56 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:46:56.243394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:56.251048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-649ac322-f07b-4f53-b6da-4ea3a476f782 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1689 microversion: 2.1 time: 0.174218 Aug 24 17:46:56.251605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 364/741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:56 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:57.219651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:57.220280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:57.226613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:57.227103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:57.227507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:57.228185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:57.228655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:57.229072 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:57.272881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:57.273811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:57.281782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:57.282261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:57.282693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:57.283384 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:57.283834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:57.284252 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:57.291716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:57.299655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:57.301179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:57.302304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b0d560e4-9356-4aee-b7f1-abc6f4a07976 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1351 microversion: 2.20 time: 0.087084 Aug 24 17:46:57.302856 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 378/742] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:57 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:57.411126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:57.418784 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-95b23b74-a432-4a6b-b1a8-8e42b1990369 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1689 microversion: 2.1 time: 0.150068 Aug 24 17:46:57.419348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 365/743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:57 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:46:58.324542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:58.325180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:58.331555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:58.332035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:58.332470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:58.333195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:58.333649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:58.334067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:58.412292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:58.421160 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:58.422665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:58.423796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-98b31857-bbab-4e35-9f0c-fdabba71c298 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1339 microversion: 2.20 time: 0.103219 Aug 24 17:46:58.424351 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 379/744] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:58 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:58.439323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:58.440536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:58.447281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:58.447762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:58.448396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:58.449122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:58.449572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:58.449993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:58.769657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:58.785666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9fa826ef-55ad-4525-924c-f19464613e61 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1689 microversion: 2.1 time: 0.350242 Aug 24 17:46:58.786471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 366/745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:58 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1689 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:46:59.446330 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:59.446946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:59.453479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:59.454058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:59.454422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:59.455122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:59.455580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:59.456012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:59.721038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:59.729737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:59.731241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:59.732353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cd282c2c-d07c-48d4-9760-2b507c8780af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.289965 Aug 24 17:46:59.733868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 380/746] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:46:59 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:59.807260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:59.807948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:46:59.814419 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:59.814998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:59.815442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:59.816141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:59.816631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:59.817066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:59.970934 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:46:59.978836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-42b5e9b7-ee53-4afc-9129-913382d22e7a tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 200 len: 1622 microversion: 2.1 time: 0.175369 Aug 24 17:46:59.979478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 367/747] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:46:59 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 1622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:00.232697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:00.245695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:00.246893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:00.247345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:00.280239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] Creating event network-changed:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:47:00.285542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-74f6cc6c-46ce-4534-94f9-26f9d35f47f6 req-a2db304f-911f-44e8-a489-402fd9ee9dbd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057288 Aug 24 17:47:00.286461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 381/748] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:00.755289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:00.755806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:00.763327 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:00.764541 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:00.765182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:00.766209 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:00.766817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:00.767393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:01.006755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:01.007378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:01.008017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 424f0287-eef6-4fa1-95d1-d811e5199185] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:01.015416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:01.016034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:01.016479 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:01.017291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:01.017582 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:01.017723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:01.018147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:01.019571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:01.020907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-34f4f006-bfa6-476b-bab4-6466430de687 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.269599 Aug 24 17:47:01.036680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] HTTP exception thrown: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Request method failure captured: Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 HTTP/1.1 Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKGZjtfUpqk-I7aBsLTwDoow31TFim1_lz_4bdzqcWhTXy8IslHKy-qrYaakTx9seATpW6aRGs0IqddNfLJmckT8DvuQw8Pl-pf6jx-z2nTsatY6zHjKdjMYdNMpjQfKQCzZ5E7_-Pm_zkWoY-Aoy1rKwiN-5C1VuhglFkWlZe95Bo Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:47:01.037777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 40c0367417434c04948e9f2a03e880a9 Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. Aug 24 17:47:01.039185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '424f0287-eef6-4fa1-95d1-d811e5199185'} Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:47:01.040078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. Aug 24 17:47:01.041517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:01.042775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Returning 404 to user: Instance 424f0287-eef6-4fa1-95d1-d811e5199185 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:47:01.042775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-216d7a65-27ca-429d-b6c3-236f5e295691 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185" status: 404 len: 111 microversion: 2.1 time: 0.036136 Aug 24 17:47:01.042775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 382/749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:00 2022] GET /compute/v2.1/servers/424f0287-eef6-4fa1-95d1-d811e5199185 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:47:01.043796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 368/750] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:00 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:01.048981 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-75f6c217-45d1-47e8-bf5a-07111025183d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '.version_select at 0x7fa666d7f0d0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:01.070683 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-75f6c217-45d1-47e8-bf5a-07111025183d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211940297" status: 202 len: 0 microversion: 2.1 time: 0.026516 Aug 24 17:47:01.071531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 383/751] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 17:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211940297 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:47:02.046975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:02.048145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:02.055376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:02.055827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:02.056258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:02.057007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:02.057455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:02.057874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:02.185950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:02.194123 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:02.195612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:02.196725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c414ff8a-02ef-4698-ad76-711041511855 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.156267 Aug 24 17:47:02.197285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 369/752] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:02 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:02.301131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424f0287-eef6-4fa1-95d1-d811e5199185", "name": "network-vif-deleted", "tag": "22185ba3-749d-45c0-a0e8-42da0ee10a5f"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:02.311070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:02.311483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:02.311910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:02.321824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] Creating event network-vif-deleted:22185ba3-749d-45c0-a0e8-42da0ee10a5f for instance 424f0287-eef6-4fa1-95d1-d811e5199185 on hv-cinder-83538 Aug 24 17:47:02.327010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-63670d92-1fb5-40e0-9fc1-711e72cb1d9f req-3b264e56-67e6-4aa8-98a8-83e5dde1f980 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029661 Aug 24 17:47:02.327560 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 384/753] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:03.218945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:03.219548 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:03.225929 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:03.226410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:03.226846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:03.227523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:03.227975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:03.228397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:03.232380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:03.444667 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:03.452828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:03.454315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:03.455414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-272be4ac-bdc9-4d2e-9c79-b4358bee91dd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.240388 Aug 24 17:47:03.456202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 370/754] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:03 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:47:03.930000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:03.930670 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:03.936849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:03.937403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:03.937905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:03.938663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:03.939213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:03.939710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:03.964904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:47:03.968944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=6 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:04.011313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:04.050012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-609b0c3e-e11e-4324-abc6-de9f19aba7c5 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 204 len: 0 microversion: 2.1 time: 0.123525 Aug 24 17:47:04.050859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 385/755] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:47:03 2022] DELETE /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:47:04.058670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:04.059288 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:04.061177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:04.061981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:04.068574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:04.069086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:04.069526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:04.070227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:04.070684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:04.071112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:04.198144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:04.206290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6b846005-72e9-4277-9fff-514475d6707d tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1508 microversion: 2.1 time: 0.151460 Aug 24 17:47:04.206855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 371/756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:04 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:04.480930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:04.481622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:04.487406 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:04.487878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:04.488304 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:04.489019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:04.489524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:04.489943 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:04.620965 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:04.629988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:04.631409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:04.632510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ca3f3ebf-6ee4-4902-a1ed-79ec66ce8d06 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.156905 Aug 24 17:47:04.633095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 386/757] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:04 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:05.227534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:05.228169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:05.235170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.235656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.236234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:05.236955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.237405 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.237824 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:05.365282 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:05.372867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a4d725eb-2d66-4f7f-bfda-2a0550a51f91 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1508 microversion: 2.1 time: 0.149205 Aug 24 17:47:05.373450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 372/758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:05 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:05.655538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:05.656180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:05.662668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.663148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.663587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:05.664276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.664758 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.665183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.051267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "name": "network-vif-plugged", "status": "completed", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:06.062851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.063633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.064178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.076149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] Creating event network-vif-plugged:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:47:06.081749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-b6040e4b-50dc-4e9c-82f6-8d9dd7accc09 req-562f13fb-0897-40e5-9bed-0ad69afc51e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Aug 24 17:47:06.083067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 373/759] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:47:06.139754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:06.150619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:06.152851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:06.155964 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-510ce3de-6ed0-4783-9474-a3aebc696772 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.503312 Aug 24 17:47:06.157014 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 387/760] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:05 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:06.395657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:06.396762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:06.406536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.406970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.407557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.409157 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.409969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.411360 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.438451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d6009a-fc4f-49b2-af48-abd6d89ab491", "name": "network-vif-deleted", "tag": "8ccacc97-2951-4972-9663-04a38f8d6f29"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:06.447693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.448171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.448628 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.459929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] Creating event network-vif-deleted:8ccacc97-2951-4972-9663-04a38f8d6f29 for instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 on hv-cinder-83538 Aug 24 17:47:06.464978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-622c68ca-0ff5-4218-8a99-0ef307aaf36e req-54e1b2d9-8f7d-4643-84ad-e2151939fedf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Aug 24 17:47:06.465983 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 388/761] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:47:06.487291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:06.495157 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-71abf1af-5f97-4658-ae16-ebc3ca264a44 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1466 microversion: 2.1 time: 0.104895 Aug 24 17:47:06.495732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 374/762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:06 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1466 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:07.180650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:07.181408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:07.188425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:07.188930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:07.189362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:07.190048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:07.190503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:07.190926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:07.322085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:07.330810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:07.332312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:07.333446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4f50a91b-4c74-4c63-8e13-9eebb14ed29f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1407 microversion: 2.20 time: 0.157133 Aug 24 17:47:07.334005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 389/763] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:07 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:07.515759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:07.516825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:07.522741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:07.523228 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:07.523671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:07.524365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:07.524851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:07.525279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:07.560385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:07.561588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:07.562028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:07.562492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lazy-loading 'fault' on Instance uuid d6d6009a-fc4f-49b2-af48-abd6d89ab491 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:47:07.602368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:07.611187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f6c196b8-1c68-49c9-ae73-e732a8bd8510 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 200 len: 1311 microversion: 2.1 time: 0.099874 Aug 24 17:47:07.611885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 375/764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:07 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:08.355722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:08.356306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:08.363225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.363704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.364142 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.364865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.365316 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.365734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.497132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:08.505904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:08.507409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:08.508576 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6f932a56-e38e-4550-a3e5-1e78da9934af tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1599 microversion: 2.20 time: 0.156835 Aug 24 17:47:08.509168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 390/765] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:47:08 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:08.530414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:08.530904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:08.537201 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.537683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.538115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.538802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.539254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.539679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.617712 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c6f1d316-2d23-4f22-935e-07611cc0ee7d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091308 Aug 24 17:47:08.618327 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 376/766] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 24 17:47:08 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:47:08.635060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:08.635662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: d6d6009a-fc4f-49b2-af48-abd6d89ab491] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:08.641556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.642032 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.642458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.643141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.643587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.644002 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.657617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] HTTP exception thrown: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Request method failure captured: Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 HTTP/1.1 Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKGZjtfUpqk-I7aBsLTwDoow31TFim1_lz_4bdzqcWhTXy8IslHKy-qrYaakTx9seATpW6aRGs0IqddNfLJmckT8DvuQw8Pl-pf6jx-z2nTsatY6zHjKdjMYdNMpjQfKQCzZ5E7_-Pm_zkWoY-Aoy1rKwiN-5C1VuhglFkWlZe95Bo Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:47:08.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 40c0367417434c04948e9f2a03e880a9 Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. Aug 24 17:47:08.660960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'd6d6009a-fc4f-49b2-af48-abd6d89ab491'} Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:47:08.661764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. Aug 24 17:47:08.662999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:47:08.664221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Returning 404 to user: Instance d6d6009a-fc4f-49b2-af48-abd6d89ab491 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:47:08.664221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a522690b-8da6-4dae-8660-434ab657f621 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491" status: 404 len: 111 microversion: 2.1 time: 0.029398 Aug 24 17:47:08.664221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 391/767] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:08 2022] GET /compute/v2.1/servers/d6d6009a-fc4f-49b2-af48-abd6d89ab491 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:47:08.669446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:08.669978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:08.676468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.676985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.677428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.678124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.678580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.679001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.706279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:47:08.792158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3b9b8ded-e658-4d54-99e4-b06b8b2d6cde tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 204 len: 0 microversion: 2.1 time: 0.125397 Aug 24 17:47:08.792778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 377/768] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:47:08 2022] DELETE /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:47:08.801993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:08.801993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:08.807947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.808418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.809008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:08.809696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:08.810140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:08.810555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:09.054057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:09.061730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0b9bf360-9578-44bf-b90c-62fc23560377 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.264208 Aug 24 17:47:09.062480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 392/769] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:08 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:09.595130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:09.605453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:09.605931 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:09.606358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:09.617393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] Creating event network-changed:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:47:09.622416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-a0b6b541-445c-402a-883a-04859f0123cb req-9bcad09e-79a4-4107-9d30-55ea081e00f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Aug 24 17:47:09.622994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 378/770] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:10.082925 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:10.083481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:10.089884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:10.090369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:10.090800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:10.091485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:10.091927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:10.092344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:10.221278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:10.229032 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-28377bd9-e3fd-491a-9a6b-b22a7977452f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.150010 Aug 24 17:47:10.229606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 393/771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:10 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:11.251388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:11.252093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:11.258677 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:11.259155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:11.259589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:11.260278 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:11.260769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:11.261191 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:11.494292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c0367417434c04948e9f2a03e880a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6986df7cf5d4be09aac96f460903bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:11.501933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c072a0b4-de9c-444f-8177-3285f7eb0d77 tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 200 len: 1521 microversion: 2.1 time: 0.254731 Aug 24 17:47:11.502704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 379/772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:11 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:11.913450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7040ce09-b5cc-4ec0-ae83-40302cb09bbd", "name": "network-vif-deleted", "tag": "4929deee-0883-4917-b21f-5b0d9f785965"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:11.924175 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:11.924676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:11.925097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:11.937135 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] Creating event network-vif-deleted:4929deee-0883-4917-b21f-5b0d9f785965 for instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd on hv-cinder-83538 Aug 24 17:47:11.942926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a896b843-f101-4492-a238-3051e33bb027 req-c862c235-24cd-44d2-856c-36657e8414eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Aug 24 17:47:11.943520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 394/773] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:12.526275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:12.526882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] [instance: 7040ce09-b5cc-4ec0-ae83-40302cb09bbd] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:12.529586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:12.536013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:12.536488 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:12.536942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:12.537644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:12.538094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:12.538512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:12.553841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] HTTP exception thrown: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Request method failure captured: Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd HTTP/1.1 Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKGZjtfUpqk-I7aBsLTwDoow31TFim1_lz_4bdzqcWhTXy8IslHKy-qrYaakTx9seATpW6aRGs0IqddNfLJmckT8DvuQw8Pl-pf6jx-z2nTsatY6zHjKdjMYdNMpjQfKQCzZ5E7_-Pm_zkWoY-Aoy1rKwiN-5C1VuhglFkWlZe95Bo Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:47:12.555528 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6986df7cf5d4be09aac96f460903bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: c6986df7cf5d4be09aac96f460903bcc Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1605011339 Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 40c0367417434c04948e9f2a03e880a9 Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1605011339-project Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. Aug 24 17:47:12.557064 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '7040ce09-b5cc-4ec0-ae83-40302cb09bbd'} Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:47:12.558313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. Aug 24 17:47:12.559688 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:47:12.561088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] Returning 404 to user: Instance 7040ce09-b5cc-4ec0-ae83-40302cb09bbd could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:47:12.561088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c03b0add-1ff1-469b-a62e-258a7687ce7f tempest-ServerRescueNegativeTestJSON-1605011339 tempest-ServerRescueNegativeTestJSON-1605011339-project] 10.222.0.45 "GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd" status: 404 len: 111 microversion: 2.1 time: 0.034535 Aug 24 17:47:12.561088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 380/774] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:12 2022] GET /compute/v2.1/servers/7040ce09-b5cc-4ec0-ae83-40302cb09bbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:47:20.918492 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7da1bb0d-7fce-44d6-bb15-75971f051824 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: .version_select at 0x7fa666bca820>, body: {"keypair": {"name": "tempest-keypair-676068200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfZACQ9rZOs3ymZ1IgacmSYp78mL7ws0uIKxDxyx3PthLhJEBtX8HCbkJMwJ27WOEUhYi+Pj1+F3JbjfdZIae8B1ohQU4Pes316eIj7Ne1iv+RHugzA+A+1x7VXavkVlw=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:20.925469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:20.936336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-7da1bb0d-7fce-44d6-bb15-75971f051824 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:47:20.941522 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-7da1bb0d-7fce-44d6-bb15-75971f051824 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for user 58652b0d60ec4134be18dafeb7ad5cb0 and project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:47:20.966586 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7da1bb0d-7fce-44d6-bb15-75971f051824 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175545 Aug 24 17:47:20.967117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 395/775] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:47:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:22.308999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-355484599", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2168aa73-4de7-4e73-8467-5e215f90ef58"}], "security_groups": [{"name": "tempest-securitygroup--1755372244"}], "key_name": "tempest-keypair-676068200", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:22.434618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] validate_networks() for [('2168aa73-4de7-4e73-8467-5e215f90ef58', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:47:22.546682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:22.818755 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:47:22.819121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:47:22.819624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:47:22.820155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:47:22.820583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:47:22.829729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:22.830155 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:22.830591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:22.831314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:22.831767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:22.832191 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:22.849131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:47:22.854311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for user 58652b0d60ec4134be18dafeb7ad5cb0 and project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:47:22.866065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:47:22.868365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:47:22.917106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4224fb32-abb5-467d-ba89-23441cff1c07 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612642 Aug 24 17:47:22.917810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 381/776] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:47:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:47:22.925806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:22.930124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dcc16d4d-9ac6-462d-9282-3fd6886ddd27 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:22.930846 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dcc16d4d-9ac6-462d-9282-3fd6886ddd27 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:22.988676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dcc16d4d-9ac6-462d-9282-3fd6886ddd27 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:22.998765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dcc16d4d-9ac6-462d-9282-3fd6886ddd27 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1236 microversion: 2.1 time: 0.073975 Aug 24 17:47:23.010398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 396/777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:22 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:24.024619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:24.025871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:24.034100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:24.035329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:24.035770 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:24.036652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:24.037259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:24.038014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:24.143507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:24.151385 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1508ae42-6de1-49c4-ac43-da7643abb5f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1296 microversion: 2.1 time: 0.133132 Aug 24 17:47:24.152290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 382/778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:24 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:25.174154 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:25.174690 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:25.181620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:25.182178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:25.182616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:25.183482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:25.183939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:25.184365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:25.265703 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:25.273280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9a895c92-06e1-49ee-8efb-53a9cfe3844e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1294 microversion: 2.1 time: 0.103668 Aug 24 17:47:25.273849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 397/779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:25 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:26.117811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0880267-479d-47c2-ac80-3061e1857262", "tag": "1994a093-a73f-4c2d-a989-12137cb15915"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:26.128873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:26.129441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:26.129881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:26.141097 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] Creating event network-changed:1994a093-a73f-4c2d-a989-12137cb15915 for instance e0880267-479d-47c2-ac80-3061e1857262 on hv-cinder-83538 Aug 24 17:47:26.145847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-8f3512a1-016e-4878-8e7d-c316004da1ee req-4ea78d52-06ed-4865-abe6-4602e06f935e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031946 Aug 24 17:47:26.146466 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 383/780] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:26.295165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:26.295813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:26.303503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:26.303972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:26.304404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:26.305132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:26.305589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:26.306009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:26.523061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:26.531432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-533e2a5e-a9c3-4034-a03c-ebb1785af4f9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.240111 Aug 24 17:47:26.532161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 398/781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:26 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:27.553484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:27.554174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:27.560301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:27.560812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:27.561239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:27.562623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:27.563070 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:27.563646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:27.699407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:27.707942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-42a60119-fdd4-4e7f-ae31-fe310f2f5dc7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.159094 Aug 24 17:47:27.708606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 384/782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:27 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:28.728354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:28.729005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:28.735484 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:28.735962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:28.736388 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:28.737102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:28.737553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:28.737973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:28.868568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:28.876621 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d06509c3-8c87-450e-8f58-852298b87f8c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.152115 Aug 24 17:47:28.877180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 399/783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:28 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:29.897102 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:29.897715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:29.903943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:29.904421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:29.904896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:29.905583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:29.906035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:29.906457 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:30.035083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:30.042652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-de30edf5-9291-4737-b060-a3f5bfa7de96 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.149428 Aug 24 17:47:30.043214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 385/784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:29 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:31.063173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:31.063783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:31.070373 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.070849 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.071275 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:31.071955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.072401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.072845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:31.201278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:31.209385 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-21401fa9-faa4-4e6e-86a8-619b9baf9a32 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.150067 Aug 24 17:47:31.209939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 400/785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:31 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:31.831063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:31.831598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:31.837951 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.838438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.838876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:31.839573 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.840029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.840456 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:31.862609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lazy-loading 'flavor' on Instance uuid 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:47:31.934768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7a60c3ec-e82b-40f1-84f5-13bacb0d1b18 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "POST /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a/action" status: 202 len: 0 microversion: 2.1 time: 0.107405 Aug 24 17:47:31.935347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 386/786] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:47:31 2022] POST /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:47:31.943611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:31.944223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:31.950303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.950757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.951365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:31.952062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:31.952516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:31.952965 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:32.089878 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:32.098388 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b23ddc1e-1a6a-4352-91ad-827f11b07ebb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.158665 Aug 24 17:47:32.098953 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 401/787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:31 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:32.187021 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0880267-479d-47c2-ac80-3061e1857262", "name": "network-vif-plugged", "status": "completed", "tag": "1994a093-a73f-4c2d-a989-12137cb15915"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:32.198170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:32.198650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:32.199087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:32.210292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] Creating event network-vif-plugged:1994a093-a73f-4c2d-a989-12137cb15915 for instance e0880267-479d-47c2-ac80-3061e1857262 on hv-cinder-83538 Aug 24 17:47:32.215086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-c726e778-75b7-4143-8366-88b0125e7a3e req-12211152-2eb6-49a1-97d3-9d506411475a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032138 Aug 24 17:47:32.215853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 387/788] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:32.230355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:32.231361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:32.238972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:32.239563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:32.240081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:32.241402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:32.242178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:32.242622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:32.406877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:32.414827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f65c6460-8b2f-4cbc-9971-fe97468a696d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.188392 Aug 24 17:47:32.415402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 402/789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:32 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:33.120584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:33.121290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:33.123683 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:33.124986 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:33.130667 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:33.131147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:33.131580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:33.132263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:33.132750 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:33.133176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:33.260292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:33.268444 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3209abaa-a906-47e4-9990-379bd5f913c0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.151836 Aug 24 17:47:33.268735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 388/790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:33 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:33.435132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:33.435734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:33.437570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=6 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:33.443401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:33.443872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:33.444301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:33.445001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:33.445446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:33.445859 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:33.574183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:33.582210 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-15c3888f-6e0f-40a4-8351-40e6db6902de tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1362 microversion: 2.1 time: 0.150971 Aug 24 17:47:33.582769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 403/791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:33 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:34.290438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:34.291040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:34.297463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.297938 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.298371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.299054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.299493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.299913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.428188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:34.437380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b6df7238-8da8-4864-82f3-69dcceb04416 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.150241 Aug 24 17:47:34.437945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 389/792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:34 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:34.603229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:34.603746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:34.610606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.611086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.611516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.612198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.612686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.613114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.741427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:34.749001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-01a0f0fb-3254-4024-a235-b667671bbb31 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1548 microversion: 2.1 time: 0.149742 Aug 24 17:47:34.750187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 404/793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:34 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:47:34.769605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:34.770101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:34.776113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.776620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.777054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.777738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:34.778219 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:34.778906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:34.852604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-84a09b06-ec5c-4d6b-bc3d-43bdfb5dddd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086762 Aug 24 17:47:34.853207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 390/794] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:47:34 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:35.458257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:35.458872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:35.464781 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:35.465303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:35.465739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:35.466425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:35.466872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:35.467288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:35.677638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:35.685381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-82bd28c5-15cd-4a05-bf6c-a5bcb4a06a49 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.231035 Aug 24 17:47:35.685948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 405/795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:35 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:35.821507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0880267-479d-47c2-ac80-3061e1857262", "tag": "1994a093-a73f-4c2d-a989-12137cb15915"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:35.831223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:35.831695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:35.832154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:35.843395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] Creating event network-changed:1994a093-a73f-4c2d-a989-12137cb15915 for instance e0880267-479d-47c2-ac80-3061e1857262 on hv-cinder-83538 Aug 24 17:47:35.848196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-dee1c1ba-64ff-48ed-9187-621182660d4e req-f58b62a8-abfe-4a52-a16d-f76dd935c987 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Aug 24 17:47:35.848994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 391/796] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:36.707452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:36.708053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:36.714528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:36.715004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:36.715625 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:36.716314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:36.716846 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:36.717248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:36.847868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:36.855957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-af707e3c-bcfa-4ba7-b252-b37d9138a154 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.152415 Aug 24 17:47:36.856536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 406/797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:36 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:37.879135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:37.879766 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:37.886416 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:37.886899 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:37.887329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:37.888012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:37.888464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:37.888914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:38.020094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:38.027736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b370c385-c81f-4321-90c2-3c4aac269097 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.153369 Aug 24 17:47:38.028304 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 392/798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:37 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:39.048923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:39.049432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:39.055857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:39.056339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:39.056810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:39.057496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:39.057946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:39.058366 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:39.185382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:39.193061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fdf0da8e-9e72-4706-a3fa-0e68bcc20211 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.148162 Aug 24 17:47:39.193618 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 407/799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:39 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:40.214470 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:40.215102 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:40.221974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:40.222453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:40.222884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:40.223595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:40.224049 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:40.224472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:40.355675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:40.363874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-be0392cf-1558-49a0-9805-94697532b294 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.153295 Aug 24 17:47:40.364436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 393/800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:40 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:41.384448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:41.385133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:41.391488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:41.391966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:41.392409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:41.393128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:41.393585 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:41.394009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:41.520191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:41.527909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-57b0c7bf-4278-4b59-83d7-1d216d9420b2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.147341 Aug 24 17:47:41.528481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 408/801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:41 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:42.550161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:42.550771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:42.557223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:42.557776 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:42.558212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:42.558892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:42.559413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:42.559887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:42.705907 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:42.713607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c136f2ef-eb86-48b0-8ba9-3f9563c2a4eb tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.168475 Aug 24 17:47:42.714173 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 394/802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:42 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:43.734945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:43.735559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:43.741737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:43.742217 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:43.742657 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:43.743359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:43.743804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:43.744221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:43.871041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:43.879267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-772407db-b436-4ee4-907b-f4112b858e0b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.148752 Aug 24 17:47:43.879764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 409/803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:43 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:44.900347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:44.901002 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:44.907844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:44.908273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:44.908748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:44.909442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:44.909906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:44.910332 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:45.040704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:45.049767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1285a70b-0a86-4269-8d40-a5ef5de3cc1c tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1569 microversion: 2.1 time: 0.153071 Aug 24 17:47:45.050399 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 395/804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:44 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:45.071212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:45.071923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:45.078342 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:45.078826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:45.079258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:45.079950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:45.080401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:45.080850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:45.109773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127241) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:47:45.173526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-34a35913-41bc-4be3-98b6-a08fcfd61051 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "POST /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a/action" status: 202 len: 0 microversion: 2.1 time: 0.106107 Aug 24 17:47:45.174046 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 410/805] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:47:45 2022] POST /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:47:45.182020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:45.182761 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:45.189771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:45.190260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:45.190696 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:45.191400 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:45.191860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:45.192322 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:45.329134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:45.337104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-263c455c-9eea-4fe3-b920-7166447bf9e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1517 microversion: 2.1 time: 0.158834 Aug 24 17:47:45.337685 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 396/806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:45 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:46.357885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:46.358503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:46.364337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:46.364854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:46.365289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:46.365972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:46.366453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:46.366875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:46.506485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:46.514353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-55743c97-4a91-45f5-a95c-3ec870f12119 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1519 microversion: 2.1 time: 0.160780 Aug 24 17:47:46.515008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 411/807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:46 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:47.536930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:47.537536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:47.543864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:47.544347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:47.544817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:47.545506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:47.545962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:47.546387 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:47.673992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:47.681894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dba240cd-46bd-463f-aab5-d0e5901e6496 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.148815 Aug 24 17:47:47.682459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 397/808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:47 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:48.209070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "name": "network-vif-unplugged", "status": "completed", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:48.219256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:48.219718 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:48.220151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:48.231225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] Creating event network-vif-unplugged:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:47:48.237195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-a5c62931-edb8-45b9-8e63-8ca40f7b6b2d req-a5ab605c-8526-42ae-b1f3-f19b5ae74021 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031684 Aug 24 17:47:48.237826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 412/809] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:48.703371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:48.703990 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:48.710475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:48.710945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:48.711382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:48.712066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:48.712526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:48.712980 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:48.731150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:48.847961 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:48.855849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-82903087-bbfd-4f85-af15-18d9896de644 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.156506 Aug 24 17:47:48.856414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 398/810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:48 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:49.877450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:49.878239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:49.884283 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:49.884735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:49.885165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:49.885844 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:49.886289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:49.886701 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:49.890708 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:50.016910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:50.024515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6991f972-cc14-4f7a-81bf-2e511fb74d32 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.152355 Aug 24 17:47:50.025170 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 413/811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:49 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:51.046311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:51.046919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:51.053427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:51.053848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:51.054277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:51.054953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:51.055401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:51.055820 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:51.184355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:51.192645 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6a44bb96-090d-4ec4-8628-1a05af9eda10 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.150026 Aug 24 17:47:51.193250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 399/812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:51 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:52.214785 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:52.215318 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:52.217646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:52.223519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:52.223996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:52.224425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:52.225141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:52.225591 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:52.226009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:52.361178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:52.368888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a334fdfa-0a54-46a6-ad00-c5393844e3e7 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.158026 Aug 24 17:47:52.369469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 414/813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:52 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:53.390160 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:53.390768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:53.393101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:53.398812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:53.399289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:53.399724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:53.400412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:53.400894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:53.401395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:53.527754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:53.535600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d33fc717-41a0-47b9-ad83-e80b20c0a7b9 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.149304 Aug 24 17:47:53.536149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 400/814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:53 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:54.556961 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:54.557564 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:54.564640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:54.565113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:54.565540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:54.566218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:54.566660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:54.567072 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:54.696487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:54.704728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7927c352-f46f-4ab2-b333-06a0c0a2cd75 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.151560 Aug 24 17:47:54.705285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 415/815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:54 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:55.725355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:55.726136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:55.732984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:55.733465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:55.733901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:55.734596 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:55.735048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:55.735565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:55.866019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:55.873810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-43f31caa-be0c-442a-a4e2-34381766f709 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.152444 Aug 24 17:47:55.874883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 401/816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:55 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:56.895669 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:56.896282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:56.902689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:56.903165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:56.903626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:56.904313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:56.905125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:56.905549 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:57.038286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:57.045966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-802d6f3b-ea6f-4f2a-b180-d53b40bca3bd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1575 microversion: 2.1 time: 0.154288 Aug 24 17:47:57.047074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 416/817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:56 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:58.067552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:58.068084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:47:58.074437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:58.074914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:58.075375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:58.076062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:58.076518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:58.076981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:58.206644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:47:58.214307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-037067d9-c9c1-4a22-a586-e3f69ed39b8b tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1562 microversion: 2.1 time: 0.150756 Aug 24 17:47:58.214873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 402/818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:47:58 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:00.297086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:00.306930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:00.307545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:00.307839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:00.318654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] Creating event network-vif-plugged:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:48:00.323532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-f57f8bb7-3cfe-46ef-8f45-b89f61b724b1 req-55ead7f8-950b-420e-9471-8c33511d22ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030073 Aug 24 17:48:00.324233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 417/819] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:17.876691 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:17.877239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:17.879189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=5 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:17.879834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=26 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:17.885350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.885829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.886263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.886950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.887403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.887837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.911029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-477b296f-a293-4c9a-9ee1-8aaaaff21d09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/ips" status: 200 len: 150 microversion: 2.1 time: 0.038846 Aug 24 17:48:17.911521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 403/820] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:48:17 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:19.233449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=7 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:19.234188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=24 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:19.238737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660d81ae-63f0-42c5-bb14-0ec5eea15a3d"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:19.241137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:19.247913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.248386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.248840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.249525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.249974 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.250906 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.488875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2be79c33-c765-4289-b187-c102be33ca56 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256730 Aug 24 17:48:19.489507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 418/821] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:48:19 2022] POST /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:27.008665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660d81ae-63f0-42c5-bb14-0ec5eea15a3d"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:27.011049 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:27.018154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.018745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.019293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.020132 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.020694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.021202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.103940 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: POST /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments HTTP/1.1 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 74 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:48:27.105674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {"volumeAttachment": {"volumeId": "660d81ae-63f0-42c5-bb14-0ec5eea15a3d"}} Aug 24 17:48:27.107272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'server_id': '320e715c-be02-44d4-a40c-e19d2b9356db', 'body': {'volumeAttachment': {'volumeId': '660d81ae-63f0-42c5-bb14-0ec5eea15a3d'}}} Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:27.108308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:27.109830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 400 to user: Invalid volume: volume 660d81ae-63f0-42c5-bb14-0ec5eea15a3d is already attached to instances: 320e715c-be02-44d4-a40c-e19d2b9356db {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a658438f-0efd-4b3e-9c11-4b2e2f5698ff tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102510 Aug 24 17:48:27.112143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 404/822] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:48:27 2022] POST /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:48:27.173262 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:27.173786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:27.179811 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.180286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.180756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.181441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.181890 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.182307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.260875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lazy-loading 'services' on Instance uuid 320e715c-be02-44d4-a40c-e19d2b9356db {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:48:27.332834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a0d2ae64-ef3f-4f2e-8937-6a443d754200 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments/660d81ae-63f0-42c5-bb14-0ec5eea15a3d" status: 202 len: 0 microversion: 2.1 time: 0.164687 Aug 24 17:48:27.333459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 419/823] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:48:27 2022] DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments/660d81ae-63f0-42c5-bb14-0ec5eea15a3d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:48:27.341811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:27.344037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:27.351481 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.351973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.352409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.353140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.353597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.354038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.383734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-eec54624-db42-4d95-93cd-5f798c14771f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045788 Aug 24 17:48:27.384283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 405/824] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:27 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:28.397005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:28.399376 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:28.405411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.406136 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.406563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:28.407267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.407711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.408125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:28.436854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b8bc6e7a-348d-43e0-b453-6b268c3a7099 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Aug 24 17:48:28.437324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 420/825] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:28 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:29.449682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:29.451847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:29.458449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.458930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.459368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.460057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.460516 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.460973 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.489764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e4dd83ac-e202-4a6b-a963-cec2ecbd25ba tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Aug 24 17:48:29.490315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 406/826] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:29 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:30.502502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:30.504670 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:30.511080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.511568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.511996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.512698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.513148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.513560 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.544235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-89a72ee8-a1ed-49fd-802b-4281b8900b95 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Aug 24 17:48:30.544820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 421/827] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:30 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:31.555844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:31.558023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:31.565413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.565894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.566330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.567020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.567478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.567905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.596269 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-941e4df3-2188-4e4f-a78d-df103401c8a1 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Aug 24 17:48:31.596859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 407/828] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:31 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:32.608460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:32.611399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:32.617710 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.618184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.618609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.619312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.619754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.620167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.649386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-431e21dc-9189-4690-a6af-e1e8e0fa152e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Aug 24 17:48:32.650337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 422/829] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:32 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:33.662125 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.664445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.670747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.671223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.671681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.672362 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.672902 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.673329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.701500 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ce325a29-34bd-43a5-8208-fbe60adb8b43 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043332 Aug 24 17:48:33.702037 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 408/830] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:48:33 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:48:33.762578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.763075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.769419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.769904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.770336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.771018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.771465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.771882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.797109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:48:33.870391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c741e4be-485d-4c6f-b29a-28d4a6d1dfbd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 204 len: 0 microversion: 2.1 time: 0.111400 Aug 24 17:48:33.871219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 423/831] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:48:33 2022] DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:48:33.880040 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.880828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.886600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.887077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.887512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.888196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.888680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.889106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:34.023415 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:34.031527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-172027a4-9f1f-4028-b621-a1a91e539f38 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1680 microversion: 2.1 time: 0.155622 Aug 24 17:48:34.032299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 409/832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:33 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:34.062482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-5643905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1534415720", "security_groups": [{"name": "tempest-secgroup-smoke-1199944032"}], "block_device_mapping_v2": [{"uuid": "a01e4a3f-4a2b-46c7-a5c1-39b31e9ff9c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4271adb9-59ee-439b-8826-7fda036d50f7"}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:34.174114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] validate_networks() for [('4271adb9-59ee-439b-8826-7fda036d50f7', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:34.527282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:34.527706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:34.528178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:34.528610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:34.529030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:34.538463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:34.538935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:34.539370 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:34.540093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:34.540542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:34.541001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:34.557263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:34.561150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Getting quotas for user af6710bfe62d4ba29dc48e2f7aba9ec5 and project 87a610c98b9b48bd96d2954604bf3078. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:34.616619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:34.618784 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a01e4a3f-4a2b-46c7-a5c1-39b31e9ff9c7',volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:34.743957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-aad17cda-adf7-4954-9d17-6be7da7065a1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685609 Aug 24 17:48:34.744622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 424/833] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:48:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:48:34.755342 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a7718142-3a29-4995-bce6-26e60000a15b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:34.755956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a7718142-3a29-4995-bce6-26e60000a15b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:34.809316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a7718142-3a29-4995-bce6-26e60000a15b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:34.815957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a7718142-3a29-4995-bce6-26e60000a15b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1092 microversion: 2.1 time: 0.064543 Aug 24 17:48:34.816517 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 410/834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:34 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:35.053151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:35.053797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:35.059769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.060246 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.060717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.061403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.061855 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.062348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.203041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.212459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6c7aedda-e4e8-4c68-8231-3be56e060f9b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1680 microversion: 2.1 time: 0.163728 Aug 24 17:48:35.213289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 425/835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:35 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:35.835525 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:35.836129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:35.843296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.843768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.844197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.845441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.845894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.846314 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.906581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.914615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-770726c3-b0be-4101-86a8-98313cd3aa33 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1190 microversion: 2.1 time: 0.083308 Aug 24 17:48:35.915172 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 411/836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:35 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:36.233862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:36.234467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:36.244793 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.245266 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.245695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.246372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.246816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.247230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.545819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:36.553868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-02ccb592-4eef-4eac-b62f-a5096e943bea tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1680 microversion: 2.1 time: 0.323802 Aug 24 17:48:36.554502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 426/837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:36 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1680 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:36.936331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:36.938262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:36.945746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.946406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.946848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.947549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.948014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.948440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.068233 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:37.076032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d53b5f19-61ae-4512-8929-691c8282e600 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1208 microversion: 2.1 time: 0.143976 Aug 24 17:48:37.076617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 412/838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:36 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:37.580292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:37.581427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:37.591303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.591795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.592236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.592980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.593443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.593870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.693150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:37.702143 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6746e638-e5eb-42eb-8280-09a670c19c87 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 200 len: 1613 microversion: 2.1 time: 0.129992 Aug 24 17:48:37.702943 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 427/839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:37 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 1613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:38.008027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e715c-be02-44d4-a40c-e19d2b9356db", "name": "network-vif-deleted", "tag": "ce909ca4-c2d4-49af-b3d8-fa097b532e08"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:38.051693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.053152 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.053850 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.067545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] Creating event network-vif-deleted:ce909ca4-c2d4-49af-b3d8-fa097b532e08 for instance 320e715c-be02-44d4-a40c-e19d2b9356db on hv-cinder-83538 Aug 24 17:48:38.074106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-82877cb3-9622-42fa-a092-54e90eb0409a req-ddbde846-e0fc-467a-a958-a8ce2ca1e924 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072552 Aug 24 17:48:38.075578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 413/840] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:38.098078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:38.098626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:38.110927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.111440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.112141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.112858 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.113536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.114391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.374119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.382877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f3a48d5f-60a6-412a-9cb0-d3cef3483843 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.289141 Aug 24 17:48:38.383701 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 428/841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:38 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:38.724284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:38.725022 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:38.732503 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.733045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.733477 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.734184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.735129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.736246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.751197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db HTTP/1.1 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:48:38.753017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:48:38.754442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '320e715c-be02-44d4-a40c-e19d2b9356db'} Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:48:38.755359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:48:38.756926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:48:38.758826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:48:38.759959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-095eb3e0-9689-40ee-af1c-88c7181fc0b6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 404 len: 111 microversion: 2.1 time: 0.040445 Aug 24 17:48:38.761156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 414/842] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:38 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:38.769183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f97f466f-8853-4d85-8131-a77be3ca5055 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '.version_select at 0x7fa66ca5eee0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:38.793177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f97f466f-8853-4d85-8131-a77be3ca5055 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458700153" status: 202 len: 0 microversion: 2.1 time: 0.027759 Aug 24 17:48:38.793759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 429/843] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 17:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458700153 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:48:39.403343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:39.403965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:39.410491 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.410981 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.411422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.412124 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.412607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.413039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.545554 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:39.553300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-30c8c925-f0b9-4081-aa3b-1d1dda5cb44d tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.153891 Aug 24 17:48:39.554224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 415/844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:39 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:39.578752 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eeb3943d-855a-434e-8e53-2894e6480667 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: .version_select at 0x7fa666bd8dc0>, body: {"keypair": {"name": "tempest-keypair-37096694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECwk+DPkCjLBoqeW6lSdtQEKxTGR4KUdOis2iFQpqHCQCKvC+n080pYQDOejqrle26ngODsh+an5VX5qmi4j/B1N2xR6L/do7L1ri0HLbmv2UX10XsxRy979wG4xmAzuw=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:39.595053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-eeb3943d-855a-434e-8e53-2894e6480667 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:39.598896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-eeb3943d-855a-434e-8e53-2894e6480667 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:39.620238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eeb3943d-855a-434e-8e53-2894e6480667 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045344 Aug 24 17:48:39.620870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 430/845] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:48:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:40.092071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ab6108-0ec1-4ded-81c9-c9b718828894", "tag": "fab33bb3-cd44-4e16-a3c0-3fb183997946"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:40.101673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.102146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.102569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.113875 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] Creating event network-changed:fab33bb3-cd44-4e16-a3c0-3fb183997946 for instance f0ab6108-0ec1-4ded-81c9-c9b718828894 on hv-cinder-83538 Aug 24 17:48:40.118600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-22611493-5d31-4c1b-8a00-f8df85418283 req-6b5c041b-bd88-4835-8ae4-80d163a00497 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030300 Aug 24 17:48:40.119182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 416/846] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:40.574910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:40.575525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:40.582358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.582837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.583272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.583968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.584421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.584880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.884813 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.893073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c6ce0c8f-1d08-4156-b495-d2ddc243ae84 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.322597 Aug 24 17:48:40.893638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 431/847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:40 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:41.319932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267212299", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1229ac7-2636-42fd-bd13-5a97e33445e1"}], "security_groups": [{"name": "tempest-securitygroup--340024017"}], "key_name": "tempest-keypair-37096694", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:41.424829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] validate_networks() for [('b1229ac7-2636-42fd-bd13-5a97e33445e1', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:41.793925 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:41.794379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:41.794858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:41.795271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:41.795681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:41.805344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.805817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.806247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.806969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.807414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.807836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.823884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:41.827728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Getting quotas for user c36a9a0d92024734b1aa007a56c6328c and project 22d1c7b9f8a94e5abc2adbad97e5a479. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:41.838391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:41.840756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:41.886015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-63cf3f04-2cf0-4d3d-8686-47727e660a74 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571108 Aug 24 17:48:41.886649 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 417/848] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:48:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:48:41.897781 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-616ca35b-6cd7-48ef-ae46-ff3dbd4997cd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:41.898476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-616ca35b-6cd7-48ef-ae46-ff3dbd4997cd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:41.915519 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:41.916109 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:41.923861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.924351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.924945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.925653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.926100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.926527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.958287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-616ca35b-6cd7-48ef-ae46-ff3dbd4997cd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.966605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-616ca35b-6cd7-48ef-ae46-ff3dbd4997cd tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1239 microversion: 2.1 time: 0.072742 Aug 24 17:48:41.967365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 432/849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:41 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:42.068652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:42.076459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-406afb7b-2d2d-49bb-a6f4-336c7bf14da9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.166027 Aug 24 17:48:42.077066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 418/850] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:41 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:42.988456 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:42.989239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:42.996537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.997497 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.997926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:42.998612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.999115 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.999532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.060636 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.068945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6dd558af-829f-4db6-8a9f-bcf3f086e221 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1297 microversion: 2.1 time: 0.084914 Aug 24 17:48:43.069503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 433/851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:42 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:43.097810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:43.098423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:43.104768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.105254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.105689 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.106380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.106830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.107253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.299686 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.307587 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cfed9430-6d22-4de7-bfd7-32e3c0cabcec tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.214097 Aug 24 17:48:43.308216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 419/852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:43 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:44.089874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:44.090485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:44.097030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.097511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.097945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.098642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.099093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.099514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.117378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:44.280783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.288672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-af101d55-9154-4bf0-8921-35b7d0e2d72e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.202709 Aug 24 17:48:44.289242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 434/853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:44 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:44.328068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:44.328722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:44.335947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.336436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.337007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.337605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.338023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.338446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.351636 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2977fdef-25df-4342-9db9-202cf965a9e7", "tag": "b4eaadac-6a89-4325-856f-015b17e4132d"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:44.366065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.366570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.366992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.379402 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] Creating event network-changed:b4eaadac-6a89-4325-856f-015b17e4132d for instance 2977fdef-25df-4342-9db9-202cf965a9e7 on hv-cinder-83538 Aug 24 17:48:44.384307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-07301f88-02ce-42e9-83fa-b328a19ad1d1 req-228b1d20-72bf-4995-a516-cfca1e1c2789 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036326 Aug 24 17:48:44.384938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 435/854] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:44.585197 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.592828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f1716ac9-8e7b-4848-8abc-1447c45fa521 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.268520 Aug 24 17:48:44.593398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 420/855] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:44 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:45.310095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:45.310782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:45.312724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:45.318578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.319042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.319468 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.320144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.320606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.321023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.447852 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.455957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0c585f78-7543-4745-bcb2-e69da8427235 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.150052 Aug 24 17:48:45.456513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 436/856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:45 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:45.614208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:45.614817 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:45.621184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.621663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.622098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.622782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.623236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.623657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.763436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.771153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a007de1d-edc4-4dfa-a305-baee7bb95be6 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.160863 Aug 24 17:48:45.771695 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 421/857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:45 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:46.477073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:46.477685 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:46.483994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.484462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.484923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.485600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.486661 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.487132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.613375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.620796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bb682c4f-ad3b-4d5e-a124-6db399528c97 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.147533 Aug 24 17:48:46.621360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 437/858] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:46 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:46.791237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:46.791774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:46.798438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.799534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.799992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.800738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.801382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.801619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.930422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.938418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5e8faba9-cff6-4462-9951-975010477bd3 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.151134 Aug 24 17:48:46.938974 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 422/859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:46 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:47.642161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:47.642809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:47.649291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.649766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.650193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.650902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.651349 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.651766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.783683 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.791204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-169f901c-969f-41c4-8402-6fefa960bb01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.152940 Aug 24 17:48:47.791762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 438/860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:47 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:47.959374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:47.959908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:47.962333 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:47.967659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.968137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.968592 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.969280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.969733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.970154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.974184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:48.098612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:48.106225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4253f8dd-431d-4fb5-aba2-7214f388489c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.151278 Aug 24 17:48:48.106793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 423/861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:47 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:48.811877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:48.812496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:48.818980 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.819465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.819900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.820619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.821069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.821502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.949420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:48.957372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7cf942ff-2113-41f7-af8f-f3ced8a72412 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.149420 Aug 24 17:48:48.957940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 439/862] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:48 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:49.127283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:49.127879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:49.134256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.134726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.135154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.135833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.136279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.136725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.264912 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.273139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-731795d9-86d0-406d-8637-ebbc2a6334c1 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.150298 Aug 24 17:48:49.273699 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 424/863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:49 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:49.977780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:49.978387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:49.980719 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:49.985873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.987007 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.987444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.988127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.988595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.989015 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.138296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.146031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b3806e17-d4b9-41d8-883b-ac9345ef820e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.172180 Aug 24 17:48:50.146600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 440/864] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:49 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:50.294137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:50.294749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:50.301127 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.301605 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.302039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.302757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.303212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.303632 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.433019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.440575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2cd78d3d-667c-4cfd-bfce-c1c66b57ed70 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.150256 Aug 24 17:48:50.441152 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 425/865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:50 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:51.167301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:51.168018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:51.175165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.175648 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.176080 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.176803 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.177253 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.177673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.302839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.310660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e6af54fb-41a5-46ff-954a-7207b5f0ccf6 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.147279 Aug 24 17:48:51.311221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 441/866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:51.461120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:51.461728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:51.467997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.468474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.468936 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.469613 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.470089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.471008 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.576691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:51.577307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:51.583214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.583693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.584124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.584837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.585292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.585713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.602796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.608512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6de2e318-f2bb-4a7a-9598-31af063d74b9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/ips" status: 200 len: 152 microversion: 2.20 time: 0.035671 Aug 24 17:48:51.609119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 442/867] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:48:51.610393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6b0b45fc-d830-4c1d-9792-573fb20da801 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.153044 Aug 24 17:48:51.610957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 426/868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:52.331130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:52.331739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:52.333601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=12 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:52.339726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.340210 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.340688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.341384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.341837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.342267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.470923 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:52.478635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a8d58985-bbdb-4d4b-b805-a8cacb06a962 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.151286 Aug 24 17:48:52.479207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 443/869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:52 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:52.631976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:52.632637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:52.634478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:52.635128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=8 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:52.641411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.641897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.642331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.643060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.643513 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.643941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.716628 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2977fdef-25df-4342-9db9-202cf965a9e7", "name": "network-vif-plugged", "status": "completed", "tag": "b4eaadac-6a89-4325-856f-015b17e4132d"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:52.726947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.727742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.728280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.746347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] Creating event network-vif-plugged:b4eaadac-6a89-4325-856f-015b17e4132d for instance 2977fdef-25df-4342-9db9-202cf965a9e7 on hv-cinder-83538 Aug 24 17:48:52.752912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-1a461385-f76c-451d-a30a-fe09462a2f42 req-07f04f5b-b058-43ba-bdae-99a45b26248a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039638 Aug 24 17:48:52.753927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 444/870] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:52.789354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:52.797098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c819d202-5275-4b5e-ba1e-7791d0e9edea tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.169691 Aug 24 17:48:52.797673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 427/871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:52 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:53.499624 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:53.500260 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:53.506759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.507225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.507649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.508323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.508796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.509212 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.636042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.643677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6e0f6cb1-68b5-4015-a892-2cc3a21955b3 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.148263 Aug 24 17:48:53.644258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 445/872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:53 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:53.651193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:53.651736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:53.658953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.659439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.659878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.660906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.661374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.661808 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.685093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lazy-loading 'flavor' on Instance uuid b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:48:53.818532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:53.819418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:53.826233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.826787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.827340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.828049 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.828837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.829243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.859678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c03b41b7-c5f7-4380-9e6b-5013c9c11492 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/action" status: 202 len: 0 microversion: 2.20 time: 0.212269 Aug 24 17:48:53.860273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 428/873] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 17:48:53 2022] POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:48:53.868657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:53.869593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:53.875801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.876290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.877300 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.878006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.878461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.878889 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.010787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.018660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c446ecf9-f9d4-48d4-9616-015ee58f67f2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.204465 Aug 24 17:48:54.019234 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 446/874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:53 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:54.039132 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.047315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.049355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.050493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-37de200e-e7e5-4182-a5a2-aab468bc9880 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.185892 Aug 24 17:48:54.051216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 429/875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:53 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:54.670687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:54.671432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:54.678457 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.678938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.679375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.680075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.680528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.680991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.776955 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab6108-0ec1-4ded-81c9-c9b718828894", "name": "network-vif-plugged", "status": "completed", "tag": "fab33bb3-cd44-4e16-a3c0-3fb183997946"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:54.788583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.789426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.789857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.802351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] Creating event network-vif-plugged:fab33bb3-cd44-4e16-a3c0-3fb183997946 for instance f0ab6108-0ec1-4ded-81c9-c9b718828894 on hv-cinder-83538 Aug 24 17:48:54.809808 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-818e2665-adb2-426f-8a47-34da8eb95ec2 req-b014e029-6d6c-401d-9f87-13eb1993e482 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037510 Aug 24 17:48:54.810586 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 430/876] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:48:54.828386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.836372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3152dc4f-cb3e-49d9-ad54-2eac2a7d2f01 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1364 microversion: 2.1 time: 0.169495 Aug 24 17:48:54.836982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 447/877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:54 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:55.039828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.040582 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.046665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.047149 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.047583 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.048275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.049364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.049868 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.074609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.075220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.081715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.082203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.082639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.083339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.083792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.087665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.236268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.244576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-88ef80db-5d00-4d39-a30c-ef7010a3b0cb tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.209000 Aug 24 17:48:55.245176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 431/878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:55.261581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.269704 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.271196 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.272343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dda6757e-f976-4aed-a065-7826774fed05 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.201655 Aug 24 17:48:55.272926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 448/879] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:55.857012 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.857557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.864679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.865161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.865598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.866285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.866734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.867158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.994050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.001602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7eaddea6-59d9-4975-acba-908bf88b4c0e tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1554 microversion: 2.1 time: 0.148651 Aug 24 17:48:56.002181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 432/880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:56.021617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:56.022128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:56.028528 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.029036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.029461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.030139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.030585 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.031004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.109643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cef6d9c7-2550-417f-b859-bc4c9d456d89 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091819 Aug 24 17:48:56.110259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 449/881] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:48:56 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:56.265002 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:56.265650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:56.271543 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.272027 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.272462 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.273185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.273639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.274078 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.295888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:56.296743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:56.303451 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.304069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.304644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.305445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.306035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.306557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.605130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.613260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-232d16ef-ef7a-42d4-a38e-28a939f34f56 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.352117 Aug 24 17:48:56.613834 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 433/882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:56 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:56.626850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.635063 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.636584 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.637730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-40e2dc06-637e-4449-98fe-b22a37c26052 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.345819 Aug 24 17:48:56.638281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 450/883] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:56 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:57.153368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2977fdef-25df-4342-9db9-202cf965a9e7", "tag": "b4eaadac-6a89-4325-856f-015b17e4132d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:57.164725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.165206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.165630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.180574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] Creating event network-changed:b4eaadac-6a89-4325-856f-015b17e4132d for instance 2977fdef-25df-4342-9db9-202cf965a9e7 on hv-cinder-83538 Aug 24 17:48:57.185947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-bfeb781a-a30e-458a-b5e7-25c0cc902cc4 req-697d84d0-a257-47a6-b511-6bfca25b3099 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036534 Aug 24 17:48:57.186873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 434/884] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:57.635249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:57.635780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:57.642124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.642602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.643029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.643712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.644157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.644581 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.661905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:57.662715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:57.669067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.669827 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.669996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.670598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.671143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.671927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.961804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.970285 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7154a7d2-b44a-4611-9959-f0cc1ccda08b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1264 microversion: 2.1 time: 0.338879 Aug 24 17:48:57.971005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 451/885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:57 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1264 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:57.974507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.983926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.985694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.987432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-576b70bc-2f3b-482d-816c-d2320b36e1f7 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.330583 Aug 24 17:48:57.988339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 435/886] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:57 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:58.991214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:58.991821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:58.998162 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:58.998639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:58.999069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:58.999757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.000206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.000652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.011166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:59.011859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:59.017927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.018415 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.018853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.019544 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.020002 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.020429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.446887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.449853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.454776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0865d1f6-b768-4685-a336-88377d69d9c2 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1451 microversion: 2.1 time: 0.467460 Aug 24 17:48:59.455950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 452/887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:58 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1451 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:59.459026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.460522 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.461712 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fc364821-74cc-414d-ab4e-c99d754bf078 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.454537 Aug 24 17:48:59.462250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 436/888] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:59 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:59.475389 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:59.475997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:59.481992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.482473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.482910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.483599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.484051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.484480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.489026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=100 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:59.610827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.618550 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7769182f-3784-4a15-bc84-768e50479b95 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1451 microversion: 2.1 time: 0.146860 Aug 24 17:48:59.619118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 453/889] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:59 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:00.485264 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:00.485783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:00.492343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.492860 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.493301 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.493993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.494450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.494878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.690508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.699886 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.701426 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.702579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ff9e5c00-2b9f-4003-a1a3-63ffc108ff52 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.221372 Aug 24 17:49:00.703140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 437/890] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:00 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:01.320090 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ab6108-0ec1-4ded-81c9-c9b718828894", "tag": "fab33bb3-cd44-4e16-a3c0-3fb183997946"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:01.330092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.331144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.331644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.342706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] Creating event network-changed:fab33bb3-cd44-4e16-a3c0-3fb183997946 for instance f0ab6108-0ec1-4ded-81c9-c9b718828894 on hv-cinder-83538 Aug 24 17:49:01.347493 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-bf8db95b-909c-4487-9866-99c5e896474a req-b5100dae-bea9-44b0-b508-382a75712fee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Aug 24 17:49:01.348155 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 454/891] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:01.727095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:01.728167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:01.738546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.739266 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.739716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.740431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.740923 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.741484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.957134 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.966204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.967989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.969567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-209a7b68-8ad1-4448-8b86-9e2a21769859 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.246640 Aug 24 17:49:01.970336 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 438/892] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:01 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:02.994166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:02.994875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:03.000893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:03.001366 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:03.001834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:03.002511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:03.002959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:03.003375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:03.130106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:03.138119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:03.139620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:03.140831 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6cc063ea-1422-4505-856d-d94c3ba6f44a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.151445 Aug 24 17:49:03.141390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 455/893] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:02 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:04.164364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:04.165003 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:04.171504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:04.171984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:04.172428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:04.173150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:04.173604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:04.174033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:04.176711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:04.307967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:04.316523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:04.318057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:04.319202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c9fad87b-caaf-43c6-9d2c-0e1934e24ff5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.158831 Aug 24 17:49:04.319762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 439/894] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:04 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:05.342677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:05.343276 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:05.350395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:05.350874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:05.351299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:05.351979 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:05.352422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:05.352872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:05.477653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:05.485720 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:05.487722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:05.488885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eec24590-339f-4ac4-afaf-72427ebae48f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.150126 Aug 24 17:49:05.489420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 456/895] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:05 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:06.511280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.511892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:06.518985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:06.519470 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:06.519908 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:06.520623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:06.521083 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:06.521510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:06.647323 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:06.655356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:06.656913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:06.658848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-287a37e7-f922-4d74-ac3c-2ba557450608 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.150999 Aug 24 17:49:06.659436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 440/896] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:07.682694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.683339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:07.690545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:07.691022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:07.691453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:07.692132 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:07.692607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:07.693028 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:07.824905 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:07.833021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:07.834512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:07.835649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6afb4a12-58e4-4cc3-9ac7-3c25aa838daa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.156909 Aug 24 17:49:07.836198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 457/897] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:08.858946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:08.859585 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:08.865950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:08.866429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:08.866861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:08.867547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:08.867999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:08.868423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:08.994253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:09.003069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:09.004574 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:09.005732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-57f42c3a-5396-4ddf-8930-8fc1721acace tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.150733 Aug 24 17:49:09.006319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 441/898] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:08 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:10.028642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:10.029175 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:10.036301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:10.036823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:10.037250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:10.037934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:10.038377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:10.038791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:10.167006 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:10.175385 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:10.176909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:10.178050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-13b73f47-ebc2-45bd-806c-7134a9d93f9b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.153499 Aug 24 17:49:10.178597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 458/899] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:10 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:11.201604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:11.202291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:11.209571 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:11.210050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:11.210485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:11.211167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:11.211614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:11.212032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:11.487469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:11.495523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:11.497065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:11.498220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7c336f20-0bbd-4b4c-a22e-63f89cad7f97 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.301062 Aug 24 17:49:11.498773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 442/900] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:11 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:12.521320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.521909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:12.527838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:12.528308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:12.528782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:12.529466 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:12.529911 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:12.530324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:12.659652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:12.667854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:12.669870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:12.671274 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1ed30ff7-3a9b-4ec0-9a71-64aef384d239 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.153886 Aug 24 17:49:12.671835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 459/901] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:13.695320 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.695927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:13.702325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:13.702802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:13.703239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:13.703915 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:13.704387 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:13.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:13.836204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:13.844185 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:13.846220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:13.847356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-36f8ad9f-ee35-4d63-ae3d-7672cf1c26a6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.155963 Aug 24 17:49:13.847914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 443/902] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:14.871725 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.872315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:14.879381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.879856 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.880282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.881009 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.881446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.881858 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.017523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.025520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.027018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.028174 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-adb42e60-e4be-4071-8236-f9a12b262ef9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.160581 Aug 24 17:49:15.028768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 460/903] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:14 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:16.051350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:16.051888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:16.058485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.058963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.059408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.060098 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.060573 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.061006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.189051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.197618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.199222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.200376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-253e29fb-a9eb-4cc0-b6ce-caf563ff867b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.153058 Aug 24 17:49:16.200962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 444/904] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:16 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:16.962790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "name": "network-vif-plugged", "status": "completed", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:16.973975 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.974502 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.974903 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.986064 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] Creating event network-vif-plugged:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:49:16.991711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-73107d79-3576-465a-9afc-1e64f57bb327 req-37c40ff2-bffe-4a04-88dd-0878a2f650dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032586 Aug 24 17:49:16.992360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 461/905] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:17.224789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:17.225335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:17.231722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.232207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.232675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.233368 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.233831 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.234257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.360313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:17.368326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:17.369862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:17.371013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-31bd8927-a735-40a7-9712-1b7da3cc6495 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1745 microversion: 2.20 time: 0.150861 Aug 24 17:49:17.371561 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 445/906] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:17 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:17.854804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:17.855398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:17.861463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.861934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.862360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.863037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.863520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.863935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.886319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a066a3ef-4928-487f-aeb5-6ad64ba52a50 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/ips" status: 200 len: 146 microversion: 2.1 time: 0.035867 Aug 24 17:49:17.886858 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 462/907] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:49:17 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:18.393575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:18.394308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:18.396701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=46 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:18.402547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.403032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.403464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.404146 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.404623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.405067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.539215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.547235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.548788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.550003 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0fb5685d-cdc7-489c-89ad-2491fa8dc45b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.160396 Aug 24 17:49:18.550553 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 446/908] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:18 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:19.594209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:19.595512 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:19.604350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.605133 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.605760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.606444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.607075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.607774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.813339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:19.823998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:19.825869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:19.827346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-736762af-7962-4c59-85a4-bfee9a5ee884 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.256791 Aug 24 17:49:19.828682 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 463/909] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:19 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:20.839189 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f968c1c6-824d-49d4-9f01-14eadd754906"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:20.841633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:20.848370 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.849114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.849728 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.850614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.851072 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.851570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.853026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:20.853800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:20.856801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=48 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:20.863022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.863717 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.864310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.865201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.865805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.866375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:21.011887 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.020168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.021766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.022913 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1f9f96a6-80f6-468b-a4d9-5174e54f52b5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.175038 Aug 24 17:49:21.028221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 464/910] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:20 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:21.121180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-eaf0b2ec-3dea-4a62-8a13-50781e597d37 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285734 Aug 24 17:49:21.127959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 447/911] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:49:20 2022] POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:22.046395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:22.046934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:22.053491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.053971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.054400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.055086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.055538 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.055955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.194358 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.203107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.204628 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.206397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1111a2c8-b253-4c96-ab2b-a935ca9c1c33 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.164067 Aug 24 17:49:22.206951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 465/912] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:22 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:23.231217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:23.232028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:23.239469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.240074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.240614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.241348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.241805 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.242236 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.415447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.424624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.426125 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.427267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-320208af-9f32-4067-bf0e-99e43030d879 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.201159 Aug 24 17:49:23.427816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 448/913] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:23 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:24.450436 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:24.451032 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:24.457803 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.458286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.458719 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.459414 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.459868 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.460288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.602929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:24.619695 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:24.622010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:24.624049 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a20e1af3-e6a3-4a86-830b-ef374725be62 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.177594 Aug 24 17:49:24.636765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 466/914] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:24 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:25.649226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:25.649864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:25.656617 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:25.657101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:25.657536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:25.658506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:25.658998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:25.659435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:25.795864 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.805018 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.807840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.809087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a95c888c-8864-4139-8cb9-2387dbf69ffe tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.163735 Aug 24 17:49:25.809911 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 449/915] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:25 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:26.836230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:26.836884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:26.844454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.845053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.846387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.847693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.848371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.849011 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.018929 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.028066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.029633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.030866 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3ae697c1-0204-4ea7-974f-859c679fd569 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.201430 Aug 24 17:49:27.031445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 467/916] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:26 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:28.056819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.058023 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.068568 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.069569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.070244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.071188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.071898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.072580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.230014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.239351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.241622 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.242954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4b9fabfb-2acd-4ed9-8573-616637afb8fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.190113 Aug 24 17:49:28.243967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 450/917] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:28.739604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:28.746592 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.747050 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.747780 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.809712 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Going to try to stop instance {{(pid=127241) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:49:28.855539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c84e36d7-ee66-4698-a9ff-58f70908205e tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action" status: 202 len: 0 microversion: 2.1 time: 0.119951 Aug 24 17:49:28.859299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 468/918] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:49:28 2022] POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:49:28.865168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.865788 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.871976 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.872494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.873042 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.873743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.874198 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.874687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.026604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.036260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-26350940-59a8-47ff-9dbf-8d5add507973 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.175440 Aug 24 17:49:29.037038 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 451/919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:29.268427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:29.269150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:29.275389 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.275876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.276308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.277074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.277524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.277942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.423169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.440818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.442407 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.444490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0521abc0-009c-4bdd-845e-b95d27955da9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.180717 Aug 24 17:49:29.445760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 469/920] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:29 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:30.058725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.060043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.067757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.068318 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.068815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.069468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.069935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.070365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.230997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.239237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4cf4dbfc-66d5-4690-876d-dc829904471c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.184613 Aug 24 17:49:30.239884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 452/921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:30 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:30.468511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.469390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.476919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.477749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.478381 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.479295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.479963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.480470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.483599 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:30.635204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.643933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.645453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.646635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-80230ed8-2bb8-484e-996e-66e6ed558dfd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.182050 Aug 24 17:49:30.647199 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 470/922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:30 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:31.260537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:31.261180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:31.267602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.268099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.268575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.269257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.269711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.270135 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.395483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.403663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-83a324d2-3879-4fff-8481-f2953122bf18 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.147057 Aug 24 17:49:31.404233 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 453/923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:31 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:31.673686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:31.674288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:31.680600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.681077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.681507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.682176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.682621 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.683066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.813606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.823705 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.825747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.826926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-452e283b-861f-4634-9322-4e80d04eb9d4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1740 microversion: 2.20 time: 0.157159 Aug 24 17:49:31.827495 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 471/924] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:31 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:32.425871 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.426476 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.433874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.434370 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.434818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.435531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.435993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.436425 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.454302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:32.723898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:32.732053 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ec3931b1-9edd-4265-bef3-f06b4ab7b286 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.310104 Aug 24 17:49:32.732628 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 454/925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:32.850160 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.850760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.857117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.857593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.858022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.858700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.859151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.859601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.993597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.001640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.003844 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.005023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d99bea0d-de47-4406-83fb-a5c4b5a25d96 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1722 microversion: 2.20 time: 0.158788 Aug 24 17:49:33.005578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 472/926] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:33.752859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:33.753470 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:33.759858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.760331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.760792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.761467 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.761913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.762331 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.902699 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.911642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2a7139f7-b97b-4471-965f-5789a1d4ee08 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.162737 Aug 24 17:49:33.912199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 455/927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:33 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:34.027728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.028267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.035509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.035988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.036423 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.037143 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.037598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.038018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.164748 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.172791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.174296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.175481 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8b297a11-ef5f-4615-b489-6b8ba6afad1c tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1722 microversion: 2.20 time: 0.151785 Aug 24 17:49:34.176068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 473/928] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:34.886958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "name": "network-vif-unplugged", "status": "completed", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:34.897066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.897627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.898091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.911607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.compute.server_external_events [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] Unable to find a host for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5. Dropping event network-vif-unplugged {{(pid=127239) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 17:49:34.912478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-fc5c3bd0-059c-438c-b7d8-745da4f98ec2 req-65a26ad2-74f3-4b47-86d1-de3547f5a2b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029758 Aug 24 17:49:34.913280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 456/929] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 17:49:34.932659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.933299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.939037 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.940062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.940496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.941218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.941668 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.942086 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.071070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.079122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c8c91507-b85f-4282-bdd6-aec51ff30001 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.150388 Aug 24 17:49:35.079677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 474/930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:35.198676 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.199277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.205132 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.205604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.206036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.206715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.207163 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.207580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.333639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.341725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.343258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.344394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8cbc95ea-a820-4549-972a-2d6fb364a6cd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1665 microversion: 2.20 time: 0.149611 Aug 24 17:49:35.344975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 457/931] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:35.367131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04d5610e-2a51-44fd-a2e3-ff089c83d3be"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:35.369519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.375343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.375822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.376282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.377587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.378042 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.378465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.649749 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4e335a3d-4648-4b12-a5d7-91e828a67c94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286606 Aug 24 17:49:35.650339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 475/932] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 24 17:49:35 2022] POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:49:35.772512 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.773033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.778954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.779435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.779883 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.780587 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.781045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.781463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.998795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7f192ca8-0431-4d35-a02b-0ae27b114da8 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments/04d5610e-2a51-44fd-a2e3-ff089c83d3be" status: 202 len: 0 microversion: 2.20 time: 0.230138 Aug 24 17:49:35.999438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 458/933] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 24 17:49:35 2022] DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments/04d5610e-2a51-44fd-a2e3-ff089c83d3be => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:49:36.065139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:36.065731 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.072679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.073220 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.073569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.074254 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.074700 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.075116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.101816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.102778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.104319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127241) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:49:36.110354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.110978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.111441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.112136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.112609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.113171 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.171413 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-670ad60d-3120-4250-9dc0-bbbd3a33ee1d tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/action" status: 202 len: 0 microversion: 2.20 time: 0.109993 Aug 24 17:49:36.172184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 476/934] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 17:49:36 2022] POST /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:49:36.180460 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.180777 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.186429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.186904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.187334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.188082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.188524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.188966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.293247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.302089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e284d02d-9285-4e52-b668-5307fc2425f2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.204194 Aug 24 17:49:36.302697 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 459/935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:36.341052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.349424 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.350932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.352143 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-483b7994-df0f-4e76-a101-d6aaafdba661 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1673 microversion: 2.20 time: 0.175797 Aug 24 17:49:36.352672 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 477/936] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:37.327383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.327998 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.334413 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.334896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.335338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.336030 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.336484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.336933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.374876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.375480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.382730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.383211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.383642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.384329 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.384802 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.385222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.595395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.603595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-08d2fab8-b3ca-449a-b6af-adba4604caa9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.280193 Aug 24 17:49:37.604166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 460/937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:37.640369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.648529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.650053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.651209 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9da1068c-8b2e-4e0d-8f24-35c2936574e6 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.280190 Aug 24 17:49:37.651763 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 478/938] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:38.626026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.626612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.633593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.634069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.634501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.635181 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.635633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.636052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.673644 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.674258 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.691377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.691864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.692298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.693035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.693489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.693909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.793285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.810701 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5a7edf5d-9d17-4cb2-942b-ea1dbc4a1259 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.186717 Aug 24 17:49:38.812017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 461/939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.989803 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.999449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.001610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.003067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e75139a1-a96e-4bb4-8658-c068a6890fb9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.333234 Aug 24 17:49:39.003848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 479/940] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:39.837861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.839624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.848569 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.849129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.849600 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.850340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.850800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.851262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.992162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.000402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c74e2093-e297-44a9-b0ea-5fe1dc99eb53 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.167981 Aug 24 17:49:40.001005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 462/941] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:40.026186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:40.026797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:40.034561 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.035051 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.035490 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.036193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.036684 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.037114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.169499 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.178355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.180022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.181420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d34db843-8782-49e2-bd06-78d430fda8a2 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.159101 Aug 24 17:49:40.182166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 480/942] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:40 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:41.023802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.024603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.031602 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.032226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.033799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.034899 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.035459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.035991 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.169810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.179723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4d74c914-fd57-48c0-8c12-8b3bf7765b66 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.160206 Aug 24 17:49:41.180598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 463/943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:41.205876 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.206489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.213478 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.213966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.214405 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.215108 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.215563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.215985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.353185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.361773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.363295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.364467 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-94e4e867-6122-4126-b032-2274d5f7a2c3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.163063 Aug 24 17:49:41.365259 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 481/944] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:42.202011 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.202648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.209995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.210484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.210927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.211633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.212093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.212523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.344967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.353663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-622fdabf-cec5-4bf4-af2e-8e2281650f23 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.155450 Aug 24 17:49:42.360115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 464/945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:42.387352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.387982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.395121 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.395603 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.396034 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.396744 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.397200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.397614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.532620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.542901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.544410 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.557927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5f413d36-6c6a-48f1-934b-427935f57a37 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.174342 Aug 24 17:49:42.558509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 482/946] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:43.375256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.375873 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.382272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.382773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.383212 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.383904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.384362 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.384906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.514621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.524402 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d7bc275b-1b2b-47ff-b0f9-ab502cd40ef4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.152916 Aug 24 17:49:43.525511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 465/947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.582551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.583180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.589595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.590065 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.590491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.591166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.591609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.592023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.594663 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:43.727357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.735677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.737219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.738359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2a0f666c-5edd-40d9-8d45-ab7ad4bd8c15 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.160313 Aug 24 17:49:43.738911 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 483/948] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:44.551025 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.552939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.560829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.561640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.562651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.563537 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.564007 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.564432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.701084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.711930 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e90aec30-f11c-4c3d-80a6-4b78a408e869 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.165017 Aug 24 17:49:44.721942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 466/949] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:44.761188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.761945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.769068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.769604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.769988 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.772698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.773393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.774043 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.922122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.931939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.933826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.935121 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-641d66d5-f438-4d7f-b6a0-a16e99533bf4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.177802 Aug 24 17:49:44.945218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 484/950] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:45.735295 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.735918 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.742977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.743464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.743897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.744620 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.745732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.746170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.898372 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.906787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2a9c16b6-2b88-4627-b72e-e03751af1404 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.175360 Aug 24 17:49:45.907651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 467/951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:45.961938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.962482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.969827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.970569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.971693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.972508 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.972986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.973506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.111894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.120328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.121908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.123223 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-48769e39-d4b3-4972-a939-2e4a7e5465a4 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.165460 Aug 24 17:49:46.123768 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 485/952] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:46.929614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:46.930343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:46.937781 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.938311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.938769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.939474 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.940044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.940484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.076011 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.084213 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7ddd9382-3708-4de6-87b5-14e07074bc84 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.159135 Aug 24 17:49:47.084811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 468/953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:46 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:47.150117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:47.150824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:47.160363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.160881 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.161320 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.162026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.162477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.163087 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.320417 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.328509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.330020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.331178 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-20cc1620-d109-4826-a261-8b6f5f7f3921 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.185128 Aug 24 17:49:47.331723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 486/954] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:47 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:48.105415 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.105999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.112366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.113510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.113947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.114625 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.115076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.115504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.119355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:48.245326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.253466 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-869369f2-6707-4c9c-bccd-0f816169d419 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.151937 Aug 24 17:49:48.254035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 469/955] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:48.354229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.354814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.361221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.361694 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.362120 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.362792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.363236 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.363648 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.492098 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.500111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.501561 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.502702 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5844a818-79f0-4e10-9efb-fe4c2885c191 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.152516 Aug 24 17:49:48.503240 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 487/956] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:49.275250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.275891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.278320 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=48 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:49.283783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.284521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.285593 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.286283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.286736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.287166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.416783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.424916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-49efd5ab-327c-42ba-9073-6ae07c30f2fe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.153589 Aug 24 17:49:49.425492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 470/957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:49.525933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.526462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.532826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.533303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.533732 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.534752 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.535180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.535597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.664195 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.672315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.673867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.675016 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c6afb653-1441-4db2-b614-6d672759f83b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.153216 Aug 24 17:49:49.675559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 488/958] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:50.445719 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.446354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.452775 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.453277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.453710 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.454398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.454849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.455273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.580103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.588702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a0ee46c5-6eb8-45e0-b66b-35713e21b86c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.146866 Aug 24 17:49:50.589273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 471/959] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:50.697527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.698062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.704530 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.705041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.705555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.706751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.707199 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.707614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.834092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.842134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.843652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.844836 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-02238cdb-1ac9-41c6-9bff-6873b1ae2ccd tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.151204 Aug 24 17:49:50.845398 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 489/960] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:51.610361 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.610999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.617815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.618290 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.618719 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.619396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.619847 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.620266 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.785857 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.794179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c7b854f8-51ec-4b5a-b531-789807bf6a92 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1723 microversion: 2.1 time: 0.187667 Aug 24 17:49:51.794747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 472/961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:51.868184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.869326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.871637 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:51.877021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.877496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.877928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.879165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.879613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.880035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.010990 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.020084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.021774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.022938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e5d2f3b2-c07c-4e0c-8e2f-7a289a970a24 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.158729 Aug 24 17:49:52.023488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 490/962] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:52.815479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:52.816095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:52.822523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.823004 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.823442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.824129 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.824619 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.825047 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.952754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.961309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ef569eef-3f90-47fe-a8f3-0464a0ea164f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1700 microversion: 2.1 time: 0.149856 Aug 24 17:49:52.961870 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 473/963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:52 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1700 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:52.982305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:52.988786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.989274 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.989711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.012448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Going to try to start instance {{(pid=127241) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:49:53.047640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.048388 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.054863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7315e156-0354-459a-b1d0-cd1f6e0b4493 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action" status: 202 len: 0 microversion: 2.1 time: 0.076328 Aug 24 17:49:53.055423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.055591 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 491/964] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:49:52 2022] POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:49:53.055910 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.056342 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.057069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.057530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.057957 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.063487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.064172 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.070383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.070851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.071280 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.071958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.072403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.072851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.252202 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.256894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.261211 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.262730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.263891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2f9326d9-87c9-4795-b81d-4c1ca51d0800 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.220343 Aug 24 17:49:53.264661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 474/965] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:53.265019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f1d428fd-a598-4866-95ea-9676fadb9804 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1709 microversion: 2.1 time: 0.205385 Aug 24 17:49:53.265579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 492/966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1709 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:54.287317 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.287984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.288094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.288674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.294948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.295418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.295542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.295859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.295989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.296536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.296693 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.297035 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.297244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.297468 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.297691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.298108 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.490329 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.493396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.498539 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-695b2ef7-b8a5-4502-a5e5-0935eb4d5f64 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1709 microversion: 2.1 time: 0.215703 Aug 24 17:49:54.499104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 475/967] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1709 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:54.501926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.503465 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.504651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e793cfca-9800-4ee0-bd59-47ec05b05283 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.221389 Aug 24 17:49:54.505198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 493/968] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:55.520257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.520895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.526589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.527204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.527765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.528259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.528743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.529447 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.529906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.530487 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.533614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.534097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.535040 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.535736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.536193 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.536651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.726288 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.732858 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.734514 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cdc350d9-d61a-4b14-b26c-3a36a95ae06b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1709 microversion: 2.1 time: 0.218218 Aug 24 17:49:55.735128 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 476/969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1709 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:55.741919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.743430 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.744607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-97b69a67-d828-41bf-b53d-0ca387a35fe3 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.221879 Aug 24 17:49:55.745154 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 494/970] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:56.757016 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.757634 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:56.763994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.764480 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.764950 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.765649 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.766174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.766532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.767237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.767924 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:56.775049 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.775544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.775978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.776739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.777202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.777613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.958506 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.962013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.967099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bd6945d4-fa09-466e-9ab5-6fd67eb352cc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1713 microversion: 2.1 time: 0.214657 Aug 24 17:49:56.968141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 477/971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1713 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:56.975488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.977060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.978218 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3d86fc60-0dc8-4ec2-8766-0b5c9795b129 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.214904 Aug 24 17:49:56.978986 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 495/972] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:58.001807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.002414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.009310 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.009785 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.010213 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.010924 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.011374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.011793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.140398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.148533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.150065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.151208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c46e8a10-5144-4529-a62d-5452d7f290fa tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.153360 Aug 24 17:49:58.151769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 478/973] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:57 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:59.132074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "name": "network-vif-plugged", "status": "completed", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:59.142062 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.142540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.142982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.154640 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] Creating event network-vif-plugged:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:49:59.159313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-f4c46264-a7a0-46d3-bacc-2b1f0f8438e4 req-abc7e986-ceba-4863-9bc9-e12777a21eda service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Aug 24 17:49:59.160485 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 496/974] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:59.174151 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:59.174764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:59.180953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.181458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.181939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.182841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.183339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.184486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.323262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.332403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.333963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.335122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-de209b2d-1d12-48cf-a7f1-8c84f511ff48 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.165051 Aug 24 17:49:59.335856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 479/975] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:59 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:00.360021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.360839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.367109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.367615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.368017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.368746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.369198 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.369623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.824899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.835254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.835746 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.844131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.845651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.847337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-31e52dd0-6079-40d7-bf26-f5286023d6bb tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.491630 Aug 24 17:50:00.847869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 497/976] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:00.851761 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.852445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.853069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.853937 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.854547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.855121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.856429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:00.867302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.867523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.867978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.879235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] Creating event network-changed:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:50:00.883418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:50:00.884593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-d96b8b2d-d7d7-457d-aa7f-3941e0a8c73b req-dbf66028-9b03-4b95-8dc8-3ddf074f4483 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035579 Aug 24 17:50:00.885336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 498/977] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:00.977403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9cc29d8c-319f-4a1f-b09d-d3ef49d610dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 204 len: 0 microversion: 2.1 time: 0.145754 Aug 24 17:50:00.978227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 480/978] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:00 2022] DELETE /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:50:00.986643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.987350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.993817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.994241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.994679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.995417 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.995816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.996427 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.129622 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.137464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fd1f5c20-2c46-45c4-8b7a-6bdb7759f858 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.155027 Aug 24 17:50:01.138024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 499/979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:01.870748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:01.871445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:01.877852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.878383 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.878818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.879497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.879949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.880374 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.006451 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.014635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.016166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.017357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8f2d6b5d-ce4c-4e78-ad0c-4689df1ade94 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.151025 Aug 24 17:50:02.017914 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 481/980] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:01 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:02.158365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.158968 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.166250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.166723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.167149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.167826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.168273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.168727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.171306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:02.305169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.312932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-650b7208-b1b8-40a0-820e-a635c16769dd tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1568 microversion: 2.1 time: 0.158400 Aug 24 17:50:02.313491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 500/981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:03.041791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.042400 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.048673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.049159 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.049594 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.050900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.051352 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.051774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.181674 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.190302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.191796 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.193024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e61bc2ac-77ae-4c9b-851c-cbb665a15df9 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1731 microversion: 2.20 time: 0.155215 Aug 24 17:50:03.193565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 482/982] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:03.335677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.336249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.342623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.343099 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.343526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.344341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.344819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.345403 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.502659 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.510390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f7b98f07-ff3a-4dd3-bd41-1d9afe3ae47a tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1450 microversion: 2.1 time: 0.180048 Aug 24 17:50:03.511092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 501/983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:03.911054 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01e19d-04e4-4a68-ac20-2d220b3e4f4a", "name": "network-vif-deleted", "tag": "2361bb79-b29a-4716-aa6d-cf7d236cda81"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:03.920954 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.921448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.921884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.936039 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] Creating event network-vif-deleted:2361bb79-b29a-4716-aa6d-cf7d236cda81 for instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a on hv-cinder-83538 Aug 24 17:50:03.941567 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-d8fcca0c-772f-4367-ae3c-07276dfbdc34 req-88116865-1ac5-4da0-8563-c51a62921397 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033902 Aug 24 17:50:03.942154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 483/984] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:04.217757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.218340 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.224272 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.224771 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.225205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.225910 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.226365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.226847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.372935 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.381716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.383219 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.384380 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-731459f4-ccc9-456d-bdbe-3efc44200a11 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1718 microversion: 2.20 time: 0.170675 Aug 24 17:50:04.384971 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 502/985] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:04.533268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.534210 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.542819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.543559 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.544112 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.544816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.545272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.545892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.583020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.583495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.584239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.584702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lazy-loading 'fault' on Instance uuid 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:50:04.588515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:04.635526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d38f974f55d4f27bafdfe06ac9dfebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45fcc8295e24580b04787b4040d3612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.644281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-25a4fb87-1591-431b-828a-7639945439f0 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 200 len: 1225 microversion: 2.1 time: 0.115929 Aug 24 17:50:04.645071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 484/986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:05.665529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.666136 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [instance: 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:05.672431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.672939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.673372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.674052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.674500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.674915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.688726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] HTTP exception thrown: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Request method failure captured: Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a HTTP/1.1 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmNhr7sd2ZwzGI46Rk5UeOOp_MyKB5wotluW4p0zHc768RH4tArGz6f2xrTaAGszee3ZRUStTw920B3UJt-2vW62I_eLQTx0J08IKvXHiFzhErgcUIYu32u8hBBoASLgo1xjvx4AnNr-wBxQNtcocyiIXu41X7mkM0VS17oYGApI7GI Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: f45fcc8295e24580b04787b4040d3612 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-TestShelveInstance-466906719 Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:05.690350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f45fcc8295e24580b04787b4040d3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f45fcc8295e24580b04787b4040d3612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f45fcc8295e24580b04787b4040d3612"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f45fcc8295e24580b04787b4040d3612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-TestShelveInstance-466906719 Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: f45fcc8295e24580b04787b4040d3612 Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-TestShelveInstance-466906719 Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-TestShelveInstance-466906719-project Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 8d38f974f55d4f27bafdfe06ac9dfebb Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-TestShelveInstance-466906719-project Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. Aug 24 17:50:05.692418 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '5a01e19d-04e4-4a68-ac20-2d220b3e4f4a'} Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:05.693308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. Aug 24 17:50:05.694920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:05.696295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Returning 404 to user: Instance 5a01e19d-04e4-4a68-ac20-2d220b3e4f4a could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:05.696295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b3aa4fd8-3640-4145-ae10-e5f2280ab71e tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a" status: 404 len: 111 microversion: 2.1 time: 0.030656 Aug 24 17:50:05.696295 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 503/987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:05 2022] GET /compute/v2.1/servers/5a01e19d-04e4-4a68-ac20-2d220b3e4f4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:05.855279 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6441596a-3073-4181-8219-ca8b5a1349f2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] Calling method '.version_select at 0x7fa66f59f4c0>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.859867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6441596a-3073-4181-8219-ca8b5a1349f2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [4c48aa47-7c67-4c9a-98d7-3bb5362cd6bd] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:50:06.867518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [None req-6441596a-3073-4181-8219-ca8b5a1349f2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] [4c48aa47-7c67-4c9a-98d7-3bb5362cd6bd] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 37176. Aug 24 17:50:06.885953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6441596a-3073-4181-8219-ca8b5a1349f2 tempest-TestShelveInstance-466906719 tempest-TestShelveInstance-466906719-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1094162370" status: 202 len: 0 microversion: 2.1 time: 1.034538 Aug 24 17:50:06.887190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 485/988] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 24 17:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1094162370 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:50:26.760945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:26.761556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:26.764578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=27 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:26.765200 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=19 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:26.769292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:26.769775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:26.770215 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:26.770909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:26.771367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:26.771800 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:26.795944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fe8f8215-453e-409a-bf33-c20a9f18d8fa tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.039059 Aug 24 17:50:26.796511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 504/989] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:50:26 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:28.115959 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:28.116736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:28.121809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33a4713f-d2e6-46b0-b05c-859179ef957b"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:28.124115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:28.131237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.131724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.132153 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.132869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.133319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.133739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.630483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9e0dff99-ca55-41b6-883f-3e338826ac79 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "POST /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515994 Aug 24 17:50:28.631284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 486/990] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:50:28 2022] POST /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:36.239633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:36.240134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:36.246551 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.247008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.247435 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.248144 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.248617 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.249036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.382470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lazy-loading 'services' on Instance uuid 2977fdef-25df-4342-9db9-202cf965a9e7 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:50:36.455828 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-06ade5dc-bcc7-4986-b772-9b340e793d9c tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments/33a4713f-d2e6-46b0-b05c-859179ef957b" status: 202 len: 0 microversion: 2.1 time: 0.219877 Aug 24 17:50:36.457462 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 505/991] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:50:36 2022] DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments/33a4713f-d2e6-46b0-b05c-859179ef957b => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:50:36.466418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:36.468759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:36.476376 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.476891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.477520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.478227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.478684 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.479113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.510187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3fac3658-0191-4ff3-b410-a2fe36595a00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048229 Aug 24 17:50:36.510741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 487/992] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:50:36 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:37.523871 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:37.526242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:37.532995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.533486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.533891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.535208 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.535662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.536083 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.563697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7d494273-2b60-4837-9ec9-dc5b7915e3c2 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044872 Aug 24 17:50:37.564243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 506/993] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:50:37 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:50:37.624285 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:37.624811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:37.631051 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.631521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.631949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.632654 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.633106 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.633523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.657932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:50:37.732681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-814e7154-5edd-4d72-97ee-ba8fb85a5134 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 204 len: 0 microversion: 2.1 time: 0.111600 Aug 24 17:50:37.733503 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 488/994] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:37 2022] DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:50:37.741790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:37.742400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:37.748322 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.748852 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.749278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.749991 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.750445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.750873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.879820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:37.887521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e1bf8b1b-a8b3-4cd8-9362-24017be09c61 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1679 microversion: 2.1 time: 0.149553 Aug 24 17:50:37.888082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 507/995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:37 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:38.910366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:38.911088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:38.917887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:38.918360 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:38.918791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:38.919472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:38.919920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:38.920340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.045773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:39.053459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f999371f-365d-4656-91f0-a819833b9f2b tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1679 microversion: 2.1 time: 0.147847 Aug 24 17:50:39.053960 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 489/996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:38 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:40.074664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:40.075313 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:40.081635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:40.082109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:40.082529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:40.083206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:40.083650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:40.084066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:40.299145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a9a0d92024734b1aa007a56c6328c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d1c7b9f8a94e5abc2adbad97e5a479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:40.307461 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-bed35544-ba40-4720-93fc-e18ec5846c00 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 200 len: 1679 microversion: 2.1 time: 0.236802 Aug 24 17:50:40.308024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 508/997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:40 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:40.665218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2977fdef-25df-4342-9db9-202cf965a9e7", "name": "network-vif-deleted", "tag": "b4eaadac-6a89-4325-856f-015b17e4132d"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:40.676349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:40.676791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:40.677283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:40.688790 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] Creating event network-vif-deleted:b4eaadac-6a89-4325-856f-015b17e4132d for instance 2977fdef-25df-4342-9db9-202cf965a9e7 on hv-cinder-83538 Aug 24 17:50:40.694532 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-a0d3f2ee-4729-449d-9952-f15f68b8658f req-8ba59ece-8b93-4c15-a057-b794d1f6f4a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033138 Aug 24 17:50:40.695107 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 490/998] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:41.328750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:41.329354 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:41.336057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:41.336568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:41.337031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:41.337909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:41.338173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:41.338598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:41.352270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 HTTP/1.1 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:41.353973 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:41.355546 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '2977fdef-25df-4342-9db9-202cf965a9e7'} Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:41.356454 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:41.358324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:41.359840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:41.359840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6aa30bda-ccf3-43ab-9da2-a8e866eaff09 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 404 len: 111 microversion: 2.1 time: 0.030535 Aug 24 17:50:41.359840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 509/999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:41 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:41.366100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2534c307-bae1-4fe0-b1d5-a8e98ba2bfc5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '.version_select at 0x7fa666d0f670>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:41.385291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2534c307-bae1-4fe0-b1d5-a8e98ba2bfc5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-37096694" status: 202 len: 0 microversion: 2.1 time: 0.023952 Aug 24 17:50:41.385890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 491/1000] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 24 17:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-37096694 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:50:43.375156 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:43.375642 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:43.381679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.382162 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.382602 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.383293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.383747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.384171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.397307 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 HTTP/1.1 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:43.398845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.400384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '2977fdef-25df-4342-9db9-202cf965a9e7'} Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:43.401238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.402429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.403688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:43.403688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-26f38b68-af78-4c96-9098-d3a60ac3cfa7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 404 len: 111 microversion: 2.1 time: 0.028933 Aug 24 17:50:43.403688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 510/1001] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:43 2022] DELETE /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:43.409298 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:43.410766 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 2977fdef-25df-4342-9db9-202cf965a9e7] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:43.417606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.418089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.418584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.419280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.419739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.420169 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.433764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 HTTP/1.1 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:50:43.435412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.436970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '2977fdef-25df-4342-9db9-202cf965a9e7'} Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:43.437840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. Aug 24 17:50:43.439103 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:43.440199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 2977fdef-25df-4342-9db9-202cf965a9e7 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:43.440199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d4d8d0a1-a099-429c-9889-c7f142651a3f tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7" status: 404 len: 111 microversion: 2.1 time: 0.031966 Aug 24 17:50:43.440199 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 492/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:43 2022] GET /compute/v2.1/servers/2977fdef-25df-4342-9db9-202cf965a9e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:44.573519 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.574018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.580355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.580885 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.581323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.582012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.582483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.582891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.596101 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db HTTP/1.1 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:44.598201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.599698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '320e715c-be02-44d4-a40c-e19d2b9356db'} Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:44.600582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.602001 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.603394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:44.603394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3a8da74c-3bd9-4847-984e-1db88e2ed5a7 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 404 len: 111 microversion: 2.1 time: 0.029884 Aug 24 17:50:44.603394 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 511/1003] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:44 2022] DELETE /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:50:44.607879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.608529 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 320e715c-be02-44d4-a40c-e19d2b9356db] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.615712 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.616200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.616659 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.617347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.617799 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.618226 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.631168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db HTTP/1.1 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:50:44.632717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.634335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '320e715c-be02-44d4-a40c-e19d2b9356db'} Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:44.635168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. Aug 24 17:50:44.636576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.638108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 320e715c-be02-44d4-a40c-e19d2b9356db could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:44.638108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-98678b84-4d74-4afb-8a1f-ec8b4a044e7a tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db" status: 404 len: 111 microversion: 2.1 time: 0.030050 Aug 24 17:50:44.638108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 493/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:44 2022] GET /compute/v2.1/servers/320e715c-be02-44d4-a40c-e19d2b9356db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:44.642306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.642807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.648837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.649317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.649757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.650445 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.650904 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.651333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.665187 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 HTTP/1.1 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:44.666724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.668237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '50e5570a-2379-45a8-935b-116885887681'} Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:44.669103 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.670302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.671612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:44.671612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-05cbee28-7a25-46d1-ba54-a0ea064642c5 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 404 len: 111 microversion: 2.1 time: 0.029583 Aug 24 17:50:44.671612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 512/1005] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:44 2022] DELETE /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:44.677215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.677863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: 50e5570a-2379-45a8-935b-116885887681] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.683794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.684280 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.684748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.685449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.685939 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.686366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.699334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 HTTP/1.1 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:50:44.700867 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.702253 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '50e5570a-2379-45a8-935b-116885887681'} Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:44.703143 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. Aug 24 17:50:44.704832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:44.706224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance 50e5570a-2379-45a8-935b-116885887681 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:44.706224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fad238d7-6077-4234-9fdd-1d38ff81f538 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681" status: 404 len: 111 microversion: 2.1 time: 0.029597 Aug 24 17:50:44.706224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 494/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:44 2022] GET /compute/v2.1/servers/50e5570a-2379-45a8-935b-116885887681 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:45.836916 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:45.837397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:45.843691 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.844171 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.844646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:45.845336 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.845788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.846214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:45.859401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e HTTP/1.1 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:50:45.860966 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.862521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'db27e2e1-eafc-4042-ac32-131c956b188e'} Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:45.863998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.865463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.866891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:45.866891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-568e1ff3-96b7-46cb-adc0-440650949296 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 404 len: 111 microversion: 2.1 time: 0.029294 Aug 24 17:50:45.866891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 513/1007] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:45 2022] DELETE /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:45.871082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:45.871698 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] [instance: db27e2e1-eafc-4042-ac32-131c956b188e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:45.878067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.879235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.879676 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:45.880363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.880853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.881284 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:45.894288 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] HTTP exception thrown: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Request method failure captured: Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e HTTP/1.1 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKKX5mb9s9srrPpYUoT6ocLb39QX9Tkg9nkTFjW_RwpOrqm6Uwv_CgK4Aq1M5onVZNcY_PxedfHY562RuuvovT8NjfTrBKfzR7AWch3OZALwMxunjxZr0bPvpqOrVxVBOrdaFP1-w6QsSXlISH4AqSL5Myz_IGTIZo6WRKRG-xmbSY Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:50:45.895791 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22d1c7b9f8a94e5abc2adbad97e5a479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 22d1c7b9f8a94e5abc2adbad97e5a479 Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-928265823 Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: c36a9a0d92024734b1aa007a56c6328c Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeNegativeTest-928265823-project Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.897502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'db27e2e1-eafc-4042-ac32-131c956b188e'} Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:45.898375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. Aug 24 17:50:45.899845 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:50:45.901230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] Returning 404 to user: Instance db27e2e1-eafc-4042-ac32-131c956b188e could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:45.901230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e6fb5f1b-f4aa-4375-b005-2b11bbdca880 tempest-AttachVolumeNegativeTest-928265823 tempest-AttachVolumeNegativeTest-928265823-project] 10.222.0.45 "GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e" status: 404 len: 111 microversion: 2.1 time: 0.029920 Aug 24 17:50:45.901230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 495/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:45 2022] GET /compute/v2.1/servers/db27e2e1-eafc-4042-ac32-131c956b188e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:05.122149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.123222 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.125945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:05.126623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=20 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:05.127206 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:05.127729 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:05.135226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.136104 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.136939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.138122 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.139685 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.140720 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.172836 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:51:05.258724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2e3c54b1-b4a2-4cec-b854-d5bc00de5eb9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 204 len: 0 microversion: 2.1 time: 0.140172 Aug 24 17:51:05.259680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 514/1009] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:51:05 2022] DELETE /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:51:05.265465 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ab6108-0ec1-4ded-81c9-c9b718828894", "tag": "fab33bb3-cd44-4e16-a3c0-3fb183997946"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:05.269000 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.269778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.275325 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.275816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.275953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.276429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.276570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.277012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.277773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.278301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.278799 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.291063 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] Creating event network-changed:fab33bb3-cd44-4e16-a3c0-3fb183997946 for instance f0ab6108-0ec1-4ded-81c9-c9b718828894 on hv-cinder-83538 Aug 24 17:51:05.298193 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-c03235e6-bfff-48b5-a8ce-0bac0e320cb2 req-cd7b531b-7fad-4fd5-874d-09b7f797e965 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177464 Aug 24 17:51:05.299316 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 496/1010] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:05.413786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.421714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9cb60e73-c21a-41f8-8f8d-d81bd12df886 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1576 microversion: 2.1 time: 0.156915 Aug 24 17:51:05.422353 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 515/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:05 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:06.443813 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:06.444564 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:06.451145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.451892 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.452343 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.453061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.453523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.453948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.618186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.626029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-eb897f41-fb60-4f20-b3cb-7c0335cc8294 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1576 microversion: 2.1 time: 0.187036 Aug 24 17:51:06.626589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 497/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:06 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:07.647956 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:07.648829 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:07.655343 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.655832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.656269 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.657159 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.657594 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.658067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.137298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.145018 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a400e374-80fb-4b46-afde-1ab6b2727f0f tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 200 len: 1457 microversion: 2.1 time: 0.501551 Aug 24 17:51:08.146282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 516/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:07 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 1457 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:08.397271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab6108-0ec1-4ded-81c9-c9b718828894", "name": "network-vif-deleted", "tag": "fab33bb3-cd44-4e16-a3c0-3fb183997946"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:08.406993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:08.407579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:08.408084 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.419738 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] Creating event network-vif-deleted:fab33bb3-cd44-4e16-a3c0-3fb183997946 for instance f0ab6108-0ec1-4ded-81c9-c9b718828894 on hv-cinder-83538 Aug 24 17:51:08.425825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-8b3e1528-4800-4330-b13d-aaf3ad3c61e9 req-29c44546-69ce-46e6-ad27-a4726c5d84ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178772 Aug 24 17:51:08.426565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 498/1014] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:09.167390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:09.168005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: f0ab6108-0ec1-4ded-81c9-c9b718828894] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:09.175631 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.176127 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.176595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.178228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.178696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.179124 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.193303 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] HTTP exception thrown: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Request method failure captured: Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 HTTP/1.1 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmK92RJo5QalArxHXh9tcrgu6mK_xWO6hE2i6n_e2UkQqii-zQ9bmMd7z_Sks1nNeCAglIwKcmMI49m_e7SwGhh7sYky4ROt8kt3JTBILYKRK8L3CgxO9KvPy9ug8UeragU2c2-pxHTguUL9sQu7cl2HFCClf839FHb_P9QSpphdwW8 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:51:09.194963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: af6710bfe62d4ba29dc48e2f7aba9ec5 Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. Aug 24 17:51:09.196480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'f0ab6108-0ec1-4ded-81c9-c9b718828894'} Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:09.200741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. Aug 24 17:51:09.202317 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:09.204397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Returning 404 to user: Instance f0ab6108-0ec1-4ded-81c9-c9b718828894 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:09.204397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-abbfcc6c-81f8-4f4a-ad42-e2bc8aeeed6b tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894" status: 404 len: 111 microversion: 2.1 time: 0.032843 Aug 24 17:51:09.204397 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 517/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:09 2022] GET /compute/v2.1/servers/f0ab6108-0ec1-4ded-81c9-c9b718828894 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:11.455523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.457828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.464446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.464975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.465398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.466418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.467028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.467452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.497137 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6377326f-fa93-4fb6-b8d3-29b2f52e889e tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045801 Aug 24 17:51:11.497681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 499/1016] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 17:51:11 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:11.561805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.562387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.568745 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.569228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.569662 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.570357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.570820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.571247 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.596005 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:51:11.673772 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1d530289-4160-425b-ae51-16284ef6b838 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 204 len: 0 microversion: 2.20 time: 0.116949 Aug 24 17:51:11.674235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 518/1017] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 17:51:11 2022] DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:51:11.683591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.684433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.690439 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.690929 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.691371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.692076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.692534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.692997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.838953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.847395 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.849565 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.850810 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-71f7225a-3bc5-4bff-ad92-3ceec8d58719 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.171472 Aug 24 17:51:11.851469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 500/1018] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:11 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:12.545168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.545977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.552162 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.552521 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918", "tag": "efd5908f-b087-4c34-9623-0c8761406440"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:12.553605 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.553880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.554590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.555109 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.555706 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.570982 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.571786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.572221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.585048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:51:12.590270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] Creating event network-changed:efd5908f-b087-4c34-9623-0c8761406440 for instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 on hv-cinder-83538 Aug 24 17:51:12.598258 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-31ab2330-29a3-4553-ac05-46f89498baa7 req-5ad3dd6f-92ee-4a84-8aac-80167dbd3719 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049248 Aug 24 17:51:12.599418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 501/1019] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:12.716019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1092d474-eff7-498b-8dbc-4f7b45aac422 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 204 len: 0 microversion: 2.1 time: 0.174537 Aug 24 17:51:12.722645 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 519/1020] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:51:12 2022] DELETE /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:51:12.728592 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.729826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.737276 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.737703 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.738150 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.740326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.740843 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.741758 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.875619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.876595 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.884977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.886350 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.886958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.887867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.888487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.889095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.889421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.899373 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4c6473ee-8aa5-48f0-8599-8e4d30a01b76 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1578 microversion: 2.1 time: 0.174942 Aug 24 17:51:12.900139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 502/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:13.038334 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.046715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.048201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.049386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d7b8aeb4-f9c7-4c86-ae77-4f071a64cd50 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.178331 Aug 24 17:51:13.064998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 520/1022] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:13.644019 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.644534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.654015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.654851 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.655298 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.656580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.657421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.658015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.753349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lazy-loading 'services' on Instance uuid e0880267-479d-47c2-ac80-3061e1857262 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:13.840437 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-c91b88e6-efb5-4b2c-be5e-4ef49f2ca862 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments/f968c1c6-824d-49d4-9f01-14eadd754906" status: 202 len: 0 microversion: 2.1 time: 0.203567 Aug 24 17:51:13.841266 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 503/1023] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:51:13 2022] DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments/f968c1c6-824d-49d4-9f01-14eadd754906 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:13.921880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.923901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.931377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.932022 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.932626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.933841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.934619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.935406 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.074550 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:14.075357 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.082139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.082716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.084348 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.085443 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.085962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.086578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.346059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.355059 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7efffd86-cab1-4c96-9368-0853d5b47456 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1578 microversion: 2.1 time: 0.437352 Aug 24 17:51:14.355770 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 521/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1578 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:14.541263 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.553943 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.556518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.558926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8aeddc16-c7d9-4122-8337-92ca1f6a67fc tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1724 microversion: 2.20 time: 0.489249 Aug 24 17:51:14.560050 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 504/1025] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:14 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1724 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:14.968312 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:14.975807 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.976297 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.976750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.998892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Going to try to stop instance {{(pid=127241) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:51:15.039174 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-654fa47a-c4df-42e8-80be-c70db27d871a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action" status: 202 len: 0 microversion: 2.1 time: 0.074566 Aug 24 17:51:15.042926 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 522/1026] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:14 2022] POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:15.049168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.050021 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.066718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.067225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.070090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.070090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.070090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.070090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.140915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918", "name": "network-vif-deleted", "tag": "efd5908f-b087-4c34-9623-0c8761406440"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:15.151959 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.152544 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.153674 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.169378 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] Creating event network-vif-deleted:efd5908f-b087-4c34-9623-0c8761406440 for instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 on hv-cinder-83538 Aug 24 17:51:15.174422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-74d6fb6d-87b1-41e2-9d2f-66753cd6934d req-4f9a8dbd-ce58-44bd-82a8-83376020182b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037401 Aug 24 17:51:15.175565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 523/1027] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:15.301964 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.312762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1f73ff3b-0e39-42c8-8502-e8f866a93bcc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.268116 Aug 24 17:51:15.313655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 505/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:15.377912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.378610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.384867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.385755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.386395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.387290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.387936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.388606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.464509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6710bfe62d4ba29dc48e2f7aba9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a610c98b9b48bd96d2954604bf3078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.473648 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-fd4f9a05-98b7-41ba-a688-86bbd56433af tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 200 len: 1226 microversion: 2.1 time: 0.099792 Aug 24 17:51:15.475305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 524/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:15.586730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.587334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.593247 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.593723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.594151 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.594835 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.595283 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.595700 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.627782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.628259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.628726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.629177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lazy-loading 'fault' on Instance uuid b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:15.674060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.683969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.685627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '892dad01ea684e6cb2d5cec659c6c4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761d3524ec174bcb8f207cff3728bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.687167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-71cd27c8-d69f-4160-b747-067e7d0a140a tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 200 len: 1371 microversion: 2.20 time: 0.104909 Aug 24 17:51:15.688259 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 506/1030] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:16.334699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.335937 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.342693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.343173 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.343804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.344504 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.344992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.345416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.496090 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.497608 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.498334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.500629 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:16.506074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-80f6abf0-11b3-4663-af25-6e3047547669 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.175154 Aug 24 17:51:16.506234 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.506650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 525/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:16.519975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.519975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.519975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.519975 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.521344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.523725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] HTTP exception thrown: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Request method failure captured: Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 HTTP/1.1 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmK92RJo5QalArxHXh9tcrgu6mK_xWO6hE2i6n_e2UkQqii-zQ9bmMd7z_Sks1nNeCAglIwKcmMI49m_e7SwGhh7sYky4ROt8kt3JTBILYKRK8L3CgxO9KvPy9ug8UeragU2c2-pxHTguUL9sQu7cl2HFCClf839FHb_P9QSpphdwW8 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:51:16.525552 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: af6710bfe62d4ba29dc48e2f7aba9ec5 Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. Aug 24 17:51:16.526913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918'} Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:16.527671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. Aug 24 17:51:16.528953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.530067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Returning 404 to user: Instance 5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:16.530067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fb93a8f5-9f81-4796-b968-1b5dd5d7ffe9 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918" status: 404 len: 111 microversion: 2.1 time: 0.033387 Aug 24 17:51:16.530067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 507/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/5e8ca041-89b6-40e4-8c1c-6b1fdf6a9918 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:16.712514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.713235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.720432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.721077 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.721545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.722242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.722693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.723177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.738994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 HTTP/1.1 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:51:16.740837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:16.742600 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'b5e8a7c0-1bca-40d4-9cc1-acf558d466e5'} Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:16.743689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:16.745324 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:16.746716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:16.746716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7a064f15-b2a9-407e-b9cd-c0e64ec9ba8b tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 404 len: 111 microversion: 2.20 time: 0.034754 Aug 24 17:51:16.746716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 526/1033] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:51:16.757501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f29e93af-e4bb-474a-b5c2-23096ae60024 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '.version_select at 0x7fa666c54160>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.779317 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f29e93af-e4bb-474a-b5c2-23096ae60024 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138125811" status: 204 len: 0 microversion: 2.20 time: 0.025744 Aug 24 17:51:16.780046 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 508/1034] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Aug 24 17:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138125811 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:51:17.002214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.002742 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.009163 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.009635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.010057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.010814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.011271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.011689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.027611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] HTTP exception thrown: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Request method failure captured: Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d HTTP/1.1 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmK92RJo5QalArxHXh9tcrgu6mK_xWO6hE2i6n_e2UkQqii-zQ9bmMd7z_Sks1nNeCAglIwKcmMI49m_e7SwGhh7sYky4ROt8kt3JTBILYKRK8L3CgxO9KvPy9ug8UeragU2c2-pxHTguUL9sQu7cl2HFCClf839FHb_P9QSpphdwW8 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:51:17.029203 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: af6710bfe62d4ba29dc48e2f7aba9ec5 Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.030557 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '1b5b60a1-b2cb-4bbd-b257-0389ddd4018d'} Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:17.031321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.032515 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.033790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Returning 404 to user: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:17.033790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0c144e4b-646d-448c-a8b8-7d681053a136 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 404 len: 111 microversion: 2.1 time: 0.032429 Aug 24 17:51:17.033790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 527/1035] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:51:16 2022] DELETE /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:17.039531 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.040141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] [instance: 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.045921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.046401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.046830 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.047511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.047958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.048379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.061678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] HTTP exception thrown: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Request method failure captured: Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d HTTP/1.1 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmK92RJo5QalArxHXh9tcrgu6mK_xWO6hE2i6n_e2UkQqii-zQ9bmMd7z_Sks1nNeCAglIwKcmMI49m_e7SwGhh7sYky4ROt8kt3JTBILYKRK8L3CgxO9KvPy9ug8UeragU2c2-pxHTguUL9sQu7cl2HFCClf839FHb_P9QSpphdwW8 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:51:17.063205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87a610c98b9b48bd96d2954604bf3078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 87a610c98b9b48bd96d2954604bf3078 Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122680891 Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: af6710bfe62d4ba29dc48e2f7aba9ec5 Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-TestVolumeBootPattern-2122680891-project Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.064965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '1b5b60a1-b2cb-4bbd-b257-0389ddd4018d'} Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:17.065727 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. Aug 24 17:51:17.066956 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:17.069363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Returning 404 to user: Instance 1b5b60a1-b2cb-4bbd-b257-0389ddd4018d could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:17.069363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-bd883537-ee80-4247-8d71-168466919545 tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d" status: 404 len: 111 microversion: 2.1 time: 0.029148 Aug 24 17:51:17.069363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 509/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/1b5b60a1-b2cb-4bbd-b257-0389ddd4018d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:17.193125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e8a7c0-1bca-40d4-9cc1-acf558d466e5", "name": "network-vif-deleted", "tag": "4ae0aaa4-0cd3-4511-b72f-3a056fc05587"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:17.202459 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.202928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.203352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.214566 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] Creating event network-vif-deleted:4ae0aaa4-0cd3-4511-b72f-3a056fc05587 for instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 on hv-cinder-83538 Aug 24 17:51:17.219879 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-df4ee1d2-c21a-43f6-9d19-d90196886e60 req-9eeffdfe-e58f-49eb-b61c-6c58606a1e04 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Aug 24 17:51:17.220520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 528/1037] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:17.528670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.528670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.534273 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.534760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.535200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.535891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.536887 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.537315 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.926401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.934575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cbfc203c-bf16-40ca-9d77-8f748d0a3781 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.411198 Aug 24 17:51:17.935147 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 510/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:18.377854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-18d7821b-938e-4949-8a61-ea6ad88db78c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] Calling method '.version_select at 0x7fa66d3901f0>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.411969 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-18d7821b-938e-4949-8a61-ea6ad88db78c tempest-TestVolumeBootPattern-2122680891 tempest-TestVolumeBootPattern-2122680891-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1534415720" status: 202 len: 0 microversion: 2.1 time: 0.038503 Aug 24 17:51:18.414679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 529/1039] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Aug 24 17:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1534415720 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:18.566861 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.568432 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.574849 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.575540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.576182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.577281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.577806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.578403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.592795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 HTTP/1.1 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:51:18.594722 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.596231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'b5e8a7c0-1bca-40d4-9cc1-acf558d466e5'} Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:18.597186 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.598393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.601564 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:18.602933 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3eb645d2-7fbc-4630-a93c-97b69e6bf4a5 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 404 len: 111 microversion: 2.20 time: 0.040697 Aug 24 17:51:18.603745 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 511/1040] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 17:51:18 2022] DELETE /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:51:18.611819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.612541 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: b5e8a7c0-1bca-40d4-9cc1-acf558d466e5] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.618776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.619180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.619826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.620507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.621382 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.622473 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.637035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 HTTP/1.1 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:51:18.638972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.640610 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'b5e8a7c0-1bca-40d4-9cc1-acf558d466e5'} Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:18.641422 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. Aug 24 17:51:18.642698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:18.643804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:18.643804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0ba0e615-ea61-4bcf-94b5-d9f55c9aa56f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5" status: 404 len: 111 microversion: 2.20 time: 0.032404 Aug 24 17:51:18.643804 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 530/1041] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:18 2022] GET /compute/v2.1/servers/b5e8a7c0-1bca-40d4-9cc1-acf558d466e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:51:18.955463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.956094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.962878 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.963638 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.964079 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.964897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.965352 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.965769 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.095592 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:19.104052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-62bbe85f-8ea2-4f19-92fb-3d455c1ef5c2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.152706 Aug 24 17:51:19.104642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 512/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:18 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:19.820823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.821357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.830506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.830996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.831431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.832138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.832638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.833298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.855083 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 HTTP/1.1 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:51:19.857008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.858845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '31b745f4-f69f-4b83-a066-cadcb0a95389'} Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:19.859646 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.860998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.864125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:19.865820 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4d7d2cc1-925f-482b-85de-94aed45e623f tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 404 len: 111 microversion: 2.20 time: 0.050317 Aug 24 17:51:19.866673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 531/1043] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 17:51:19 2022] DELETE /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:51:19.874963 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.875718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] [instance: 31b745f4-f69f-4b83-a066-cadcb0a95389] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.882478 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.883136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.883681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.884498 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.885101 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.885622 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.899915 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] HTTP exception thrown: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Request method failure captured: Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 HTTP/1.1 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmKLphCrqwlGo5qgfGDSdK2kLN-IhvOjePejL3ZC-ecU9zb3Qxz-PZjJGh9fTsNgeSJdxf0aTa903x--T7UhyY1Z9a_sHCdhy4mLZ2u8RofNTl084yeQ3KQ-nPnaSoTVhVwFQlBCYrTk8gjgtDXrn4Wqa33gR4u2KFpi1ibMbhfdaL8 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:51:19.903995 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/761d3524ec174bcb8f207cff3728bcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 761d3524ec174bcb8f207cff3728bcea Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732476844 Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 892dad01ea684e6cb2d5cec659c6c4b9 Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732476844-project Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.905626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '31b745f4-f69f-4b83-a066-cadcb0a95389'} Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:19.906403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. Aug 24 17:51:19.907665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:19.908825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] Returning 404 to user: Instance 31b745f4-f69f-4b83-a066-cadcb0a95389 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:19.908825 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-32684227-cdd3-499a-a115-42ca7291e248 tempest-AttachVolumeShelveTestJSON-732476844 tempest-AttachVolumeShelveTestJSON-732476844-project] 10.222.0.45 "GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389" status: 404 len: 111 microversion: 2.20 time: 0.035684 Aug 24 17:51:19.912183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 513/1044] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/31b745f4-f69f-4b83-a066-cadcb0a95389 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:51:20.129671 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:20.130607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:20.138476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.139542 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.140176 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.142506 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.143728 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.144351 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.394488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.405588 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1deb3839-1389-4441-a38d-a94d06386f3b tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.283556 Aug 24 17:51:20.407511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 532/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:20 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:21.427836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.428503 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.438406 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.440277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.440766 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.441756 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.442380 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.443657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.711921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.725032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4e05df79-ae97-467a-bb22-5701936933b7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.301454 Aug 24 17:51:21.730412 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 514/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:22.751631 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.752853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.760765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.761703 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.762254 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.763052 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.763577 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.764070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.101681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.110767 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-cb2eda2a-8387-4917-b2e7-7d3292b8415a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.363279 Aug 24 17:51:23.111337 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 533/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:24.131224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.131842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.144334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.144855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.146414 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.147219 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.148540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.149165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.563115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.571204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-51e55ac3-b02b-483c-a663-d0aa2cb4ca57 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.443930 Aug 24 17:51:24.571840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 515/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:25.593652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.594361 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.608713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.610647 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.611608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.613256 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.615130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.617114 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.784623 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.803248 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0c8db3ee-10cf-42d1-bf0c-d0e1e78766aa tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.213638 Aug 24 17:51:25.804934 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 534/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:26.434411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cf6d16bc-c94c-4c78-a7a5-500d154094dd tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Action: 'create', calling method: .version_select at 0x7fa666d0f9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1702450232", "metadata": {"Type": "work"}}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:26.824947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.826428 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.840061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.840873 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.843821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.845396 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.846751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.847400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.868749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cf6d16bc-c94c-4c78-a7a5-500d154094dd tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.562111 Aug 24 17:51:26.870168 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 516/1050] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 17:51:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 564 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:51:26.884088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-93d23d90-3981-4ba5-8b2c-e395a591141c tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa666d2ea60>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.991440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-93d23d90-3981-4ba5-8b2c-e395a591141c tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 200 len: 353 microversion: 2.1 time: 0.112769 Aug 24 17:51:26.994287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 517/1051] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:27.150443 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.165769 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3ad1e1b9-75d8-4a2d-b323-6edc794cd692 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.344110 Aug 24 17:51:27.166939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 535/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:28.007481 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9c6a2935-26bd-4d15-91e0-911e7eac3f78 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa666db1d30>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.057418 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9c6a2935-26bd-4d15-91e0-911e7eac3f78 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 200 len: 354 microversion: 2.1 time: 0.054313 Aug 24 17:51:28.058077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 518/1053] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:28.071111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9cd4fbeb-c464-4615-aa3a-1f91e37b0f58 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa66f55cc10>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.119831 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9cd4fbeb-c464-4615-aa3a-1f91e37b0f58 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 200 len: 354 microversion: 2.1 time: 0.053001 Aug 24 17:51:28.120477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 536/1054] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:28.138261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e5dea931-7906-4a3a-acec-2c9855110397 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa666d13700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.187421 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.188036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.215271 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e5dea931-7906-4a3a-acec-2c9855110397 tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 202 len: 0 microversion: 2.1 time: 0.080599 Aug 24 17:51:28.216191 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 519/1055] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:51:28 2022] DELETE /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:28.221688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.222667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.224118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.226841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.226949 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-85a11062-2829-4b2f-95b2-54366ae3d77d tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa666d72700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.227190 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.227673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.282604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-85a11062-2829-4b2f-95b2-54366ae3d77d tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 200 len: 353 microversion: 2.1 time: 0.062127 Aug 24 17:51:28.289121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 520/1056] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:28.378501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.387739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-254bbe77-c36c-4d6e-9aa3-4decabda6793 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.204152 Aug 24 17:51:28.388698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 537/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:29.297122 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4aba2255-e0d2-408e-8d20-31706c8e97be tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Calling method '.version_select at 0x7fa666c68040>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.324250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-4aba2255-e0d2-408e-8d20-31706c8e97be tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] HTTP exception thrown: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4aba2255-e0d2-408e-8d20-31706c8e97be tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Request method failure captured: Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 HTTP/1.1 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmUen02cQ14yQ2OGhieskhb9ldEAppPjbo-5SMXBW4hQkIV1tAHWcmsohFc8G43n4webkj7RVeWbYmPU-OAE2Gmk7jBg-NT9Vs4A2VgAPoA2lx77nRfiIttYiPT0lHbTVRSe9B23B6hqnAl47xUS3kUVVf3sAxhOSVTXLj0rBy9Ccys Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 88f97da619354ec781766f418079da18 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesGetTestJSON-903021778 Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:51:29.326724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/88f97da619354ec781766f418079da18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/88f97da619354ec781766f418079da18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_88f97da619354ec781766f418079da18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/88f97da619354ec781766f418079da18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesGetTestJSON-903021778 Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 88f97da619354ec781766f418079da18 Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesGetTestJSON-903021778 Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesGetTestJSON-903021778-project Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 56d7d40ab72d459ab4ae8fa5bb245a6d Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesGetTestJSON-903021778-project Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '9d741db3-176c-4c18-ad63-0c288d461fd2'} Aug 24 17:51:29.328347 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. (HTTP 404) (Request-ID: req-b5a16690-1532-42a1-805c-5cbe9608d0c0) Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:29.329359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:51:29.330782 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:51:29.332121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4aba2255-e0d2-408e-8d20-31706c8e97be tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] Returning 404 to user: Volume 9d741db3-176c-4c18-ad63-0c288d461fd2 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4aba2255-e0d2-408e-8d20-31706c8e97be tempest-VolumesGetTestJSON-903021778 tempest-VolumesGetTestJSON-903021778-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2" status: 404 len: 109 microversion: 2.1 time: 0.035581 Aug 24 17:51:29.333993 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 521/1058] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/os-volumes/9d741db3-176c-4c18-ad63-0c288d461fd2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:29.411141 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.412326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.419021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.419504 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.419939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.420654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.421107 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.421534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.555775 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.564073 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8fa45ee3-0d67-4f07-b284-2092a2c2d7a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1677 microversion: 2.1 time: 0.156768 Aug 24 17:51:29.564667 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 538/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.586239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.586858 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.592841 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.593319 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.593748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.594442 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.594890 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.595309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.722816 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.731210 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f9b73484-2ba0-46e6-a00c-49d00189da76 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1654 microversion: 2.1 time: 0.149235 Aug 24 17:51:30.731771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 522/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.751791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:30.758521 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.759102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.759611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.784359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Going to try to start instance {{(pid=127241) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:51:30.828815 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1fcaa477-5ad5-4952-adb5-da1bfb58e010 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action" status: 202 len: 0 microversion: 2.1 time: 0.080794 Aug 24 17:51:30.838270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.839091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.844367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 539/1061] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:30 2022] POST /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:30.845660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.846136 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.846774 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.847484 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.848026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.852088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.854818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:31.035452 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.044089 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-27d46e7e-80f9-4975-a4d4-2a85e360b1a7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1663 microversion: 2.1 time: 0.209923 Aug 24 17:51:31.044879 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 523/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1663 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:32.066401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.067608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.073696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.074429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.074955 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.075972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.076613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.077267 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.237837 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.246315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e1bcb929-828c-4384-8048-3f47f522e90c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1663 microversion: 2.1 time: 0.184790 Aug 24 17:51:32.246976 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 540/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:33.267888 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.269183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.275736 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.276302 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.276837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.277735 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.278377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.278992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.437564 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.446337 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7d230eae-e1b5-4ee4-a8d7-6d026fd1d258 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1667 microversion: 2.1 time: 0.182249 Aug 24 17:51:33.446903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 524/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1667 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:40.845372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:40.846235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:40.851066 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:40.853238 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:40.860509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.861047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.861580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.862872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.863321 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.863751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.892842 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dd40b953-789b-4550-9d89-0719e1500b12 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049283 Aug 24 17:52:40.893915 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 541/1065] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:40 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:52:40.951510 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:40.952200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=10 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:40.956661 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:40.957158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:40.964006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.964486 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.964952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.965638 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.966095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.966526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.990922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:41.067177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-341242c4-d658-466b-b17b-c29940654e00 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 204 len: 0 microversion: 2.1 time: 0.116403 Aug 24 17:52:41.068205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 525/1066] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:52:40 2022] DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:41.079463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:41.080118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:41.086552 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.087029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.087448 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.088137 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.088604 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.089026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.227392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.235450 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b44efbf8-0a9b-45ac-98b3-7acbf4b91c05 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1673 microversion: 2.1 time: 0.162761 Aug 24 17:52:41.236314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 542/1067] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:41 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:42.257922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.258618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.264694 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.265180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.265614 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.266308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.266763 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.267187 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.510419 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.519330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-d124a1cd-46d4-4ec6-b894-cca10a7e1035 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1673 microversion: 2.1 time: 0.265419 Aug 24 17:52:42.519900 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 526/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:42 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:43.469288 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0880267-479d-47c2-ac80-3061e1857262", "name": "network-vif-deleted", "tag": "1994a093-a73f-4c2d-a989-12137cb15915"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:43.497743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.501947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.503639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.517346 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] Creating event network-vif-deleted:1994a093-a73f-4c2d-a989-12137cb15915 for instance e0880267-479d-47c2-ac80-3061e1857262 on hv-cinder-83538 Aug 24 17:52:43.523676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-47d114c7-a517-45a5-8e2a-a407b34d4ba5 req-24e44dfe-a1b5-4855-af35-03f6c466967c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058646 Aug 24 17:52:43.524534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 543/1069] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:43.547492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.550091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.559842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.560853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.561482 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.562358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.563006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.563595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.614515 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.616090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.616863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.617855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lazy-loading 'fault' on Instance uuid e0880267-479d-47c2-ac80-3061e1857262 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:43.666312 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.678190 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ee92937c-2f4c-4ff1-a538-4315e1e82de7 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 200 len: 1326 microversion: 2.1 time: 0.134494 Aug 24 17:52:43.679188 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 527/1070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 1326 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:44.701693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.702386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.709371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.709838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.710261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.711031 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.711477 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.711946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.726927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 HTTP/1.1 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:52:44.731391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:52:44.733152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'e0880267-479d-47c2-ac80-3061e1857262'} Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:44.734582 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:52:44.736987 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:52:44.738656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:44.738656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d2394510-6bde-4d2a-a42d-0a3a72ccd367 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 404 len: 111 microversion: 2.1 time: 0.035367 Aug 24 17:52:44.738656 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 544/1071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:52:44.742177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-974e7e17-b0cd-4502-acd4-e63fef75ca17 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '.version_select at 0x7fa666cfd700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.761952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-974e7e17-b0cd-4502-acd4-e63fef75ca17 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676068200" status: 202 len: 0 microversion: 2.1 time: 0.023570 Aug 24 17:52:44.762716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 528/1072] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 17:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676068200 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:52:45.498666 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0cb171b9-b0a0-4a47-8bf9-773e68c67ef3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: .version_select at 0x7fa66f587af0>, body: {"keypair": {"name": "tempest-keypair-108104033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2BwnR+pg5Y2jD130/GcqWd7pT6kbssmSZeNGMS4t1vlGeWCB/DO9cGO5arouhle/1He4PU7oujP18uBo+GGjNIErryLBx2sizgoLikMzehnRYMAW/ZiEZg9JpsBnegdw=="}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:45.513819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-0cb171b9-b0a0-4a47-8bf9-773e68c67ef3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:45.518167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-0cb171b9-b0a0-4a47-8bf9-773e68c67ef3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for user 58652b0d60ec4134be18dafeb7ad5cb0 and project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'key_pairs'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:45.543027 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0cb171b9-b0a0-4a47-8bf9-773e68c67ef3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048417 Aug 24 17:52:45.544895 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 545/1073] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:52:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:46.943984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-338905058", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2168aa73-4de7-4e73-8467-5e215f90ef58"}], "security_groups": [{"name": "tempest-securitygroup--1090875460"}], "key_name": "tempest-keypair-108104033", "user_data": "}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:47.055882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] validate_networks() for [('2168aa73-4de7-4e73-8467-5e215f90ef58', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:52:47.588953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:52:47.589438 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:52:47.589919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:52:47.590356 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:52:47.590792 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:52:47.600349 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.600865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.601305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.602031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.602488 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.602916 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.619920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:47.623896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Getting quotas for user 58652b0d60ec4134be18dafeb7ad5cb0 and project 75c39bcd24354fd5b79179c48abc07f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:47.634723 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:52:47.637029 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:52:47.683702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR oslo.messaging._drivers.impl_rabbit [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [8b078568-0c74-4011-9e0f-d690dc2bc041] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:52:48.692644 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [8b078568-0c74-4011-9e0f-d690dc2bc041] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39062. Aug 24 17:52:48.697919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-843d455f-2255-45d0-9c6a-71a449521066 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.760137 Aug 24 17:52:48.698557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 529/1074] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:52:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:52:48.712097 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b2857e4f-393b-4363-99a9-d5ae12a897b8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:48.714355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b2857e4f-393b-4363-99a9-d5ae12a897b8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:48.800439 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b2857e4f-393b-4363-99a9-d5ae12a897b8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:48.809357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b2857e4f-393b-4363-99a9-d5ae12a897b8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1236 microversion: 2.1 time: 0.102492 Aug 24 17:52:48.809927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 546/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:48 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:49.831590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fa8b5523-681f-4141-822a-86c606779e8d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.832215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fa8b5523-681f-4141-822a-86c606779e8d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:50.241759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fa8b5523-681f-4141-822a-86c606779e8d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:50.250004 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fa8b5523-681f-4141-822a-86c606779e8d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1236 microversion: 2.1 time: 0.423567 Aug 24 17:52:50.250670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 530/1076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:49 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1236 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:51.271949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-45127986-1819-44e8-ab56-e56f77c52963 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:51.273012 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-45127986-1819-44e8-ab56-e56f77c52963 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:51.341094 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-45127986-1819-44e8-ab56-e56f77c52963 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:51.351041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-45127986-1819-44e8-ab56-e56f77c52963 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1236 microversion: 2.1 time: 0.083462 Aug 24 17:52:51.352832 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 547/1077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:51 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:52.374365 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.375108 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:52.383496 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.384141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.384737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.385445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.386130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.386582 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.462220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:52.470224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ac50e1df-39c8-419c-a8d1-6347615620e1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1240 microversion: 2.1 time: 0.099884 Aug 24 17:52:52.470992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 531/1078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:52 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:53.492565 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:53.496113 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:53.504886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.505770 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.506574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.507632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.508390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.509254 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.614067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:53.622241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-81c6ab2d-18ec-4107-8e2d-ed36b6652ce8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1232 microversion: 2.1 time: 0.134272 Aug 24 17:52:53.633654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 548/1079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:53 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1232 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:54.647844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:54.649511 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.657905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.659317 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.660009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.662099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.663009 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.663655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.793837 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.809421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7d062c20-b07d-446f-86f7-7f7d3e857271 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1294 microversion: 2.1 time: 0.165421 Aug 24 17:52:54.810481 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 532/1080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:54 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:54.930688 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:52:54.931746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Wed Aug 24 17:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:52:55.831131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:55.831793 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:55.841765 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.842271 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.843143 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.844938 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.845616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.846503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.145579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:56.156230 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-21cf6c85-ca73-4cc1-8912-beaae0aa590d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.329224 Aug 24 17:52:56.170029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 549/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:55 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:57.080826 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3", "tag": "d5e31f41-ce76-4380-9f14-803f75245db8"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:57.097451 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.099116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.099564 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.119299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] Creating event network-changed:d5e31f41-ce76-4380-9f14-803f75245db8 for instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 on hv-cinder-83538 Aug 24 17:52:57.128156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-188bca29-3ae8-4a2d-afc2-9d87c38637a6 req-5886c89c-65dd-4be7-9b36-8e80275693fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051009 Aug 24 17:52:57.138739 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 533/1082] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:57.178583 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.179834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.186693 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.187503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.188116 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.189030 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.189651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.190242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.540084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:57.548026 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-0dab7741-191d-41e8-9975-0763ac9d7830 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.373259 Aug 24 17:52:57.548847 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 550/1083] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:57 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:58.566062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:58.571502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.572231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.579174 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.579656 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.580225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.580946 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.581449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.581924 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.722454 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.729921 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-620abd40-e330-41f0-a2bd-18a78d165f29 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.164765 Aug 24 17:52:58.730507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 534/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:59.751318 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.752751 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.761205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.761874 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.762489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.763620 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.764255 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.764882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.088435 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.100794 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-175953ac-fc5f-446a-8019-f4e5fdb83f6d tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.353268 Aug 24 17:53:00.101697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 551/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:01.123449 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.125970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.133877 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=8 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:01.137281 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.138068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.138734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.139655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.140366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.140926 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.288970 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.299598 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7899cc76-f060-43e5-9a76-4bc6d710bfd2 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.180084 Aug 24 17:53:01.300542 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 535/1086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:02.328084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:02.329507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:02.336616 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=8 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:02.339298 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.339855 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.340341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.341147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.341681 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.342352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.490415 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.501680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d9ae737a-8660-4b56-8a49-0552d7b213a0 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.183195 Aug 24 17:53:02.502536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 552/1087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:02 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:03.525092 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.526408 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.534339 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.535224 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.536423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.537355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.538031 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.538720 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.687094 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:03.696642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-22c8f753-a608-465c-933f-052118f6d19a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.175755 Aug 24 17:53:03.697227 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 536/1088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:04.238160 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3", "name": "network-vif-plugged", "status": "completed", "tag": "d5e31f41-ce76-4380-9f14-803f75245db8"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:04.252118 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.252899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.253326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.267464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] Creating event network-vif-plugged:d5e31f41-ce76-4380-9f14-803f75245db8 for instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 on hv-cinder-83538 Aug 24 17:53:04.272491 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-6d5f3ce3-9c67-4edc-bab1-4d575f6822b5 req-6dc871d6-765d-46cf-9de1-8f42ebf49eb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206746 Aug 24 17:53:04.273147 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 553/1089] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:04.719885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.720435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.727183 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.727673 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.728321 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.731237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.731237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.731237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.882265 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.893222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-81e8d31c-19ad-4fc3-a447-4028337d315a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.177489 Aug 24 17:53:04.894091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 537/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:05.916326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.917047 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.924639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.925362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.925989 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.926696 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.927148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.927577 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.100573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:06.111816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e87a8aef-3547-4d8d-8c8e-b64c3425c917 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1362 microversion: 2.1 time: 0.200103 Aug 24 17:53:06.112639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 554/1091] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:07.134324 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.134874 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.142568 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.143071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.143508 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.144235 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.144748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.145184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.289743 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:07.297603 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9fb6caf6-78d8-4f79-b521-6c6829ffe266 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1547 microversion: 2.1 time: 0.167465 Aug 24 17:53:07.298409 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 538/1092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:07 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:07.317994 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.318534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.325377 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.325864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.326290 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.327539 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.327997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.328424 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.416143 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-69f0ab48-5f0b-4880-ac7c-f33e3985c386 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101934 Aug 24 17:53:07.417392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 555/1093] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 17:53:07 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:07.787090 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b7371923-7e33-4835-bf3d-5babe9eea066 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'create', calling method: .version_select at 0x7fa666d4a700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1355217158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFjll076h8+qadk2XtEh2Gken3Jz2j2SY9JkshRV9siNgOWbYhp7yH1EfLosbMs5zxrLR8InNYxQHV5Unh4SxMW03cwobjH/j1geNeoefsZxzf0YWTjoTTwiryL/34SCg=="}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:07.802664 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-b7371923-7e33-4835-bf3d-5babe9eea066 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Getting quotas for project 2de47efc59f04643ab02651d40b77067. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:07.806492 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-b7371923-7e33-4835-bf3d-5babe9eea066 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Getting quotas for user 127dbee9996d4c9e8f8603edaa579e36 and project 2de47efc59f04643ab02651d40b77067. Resources: {'key_pairs'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:07.829074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b7371923-7e33-4835-bf3d-5babe9eea066 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046044 Aug 24 17:53:07.829676 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 539/1094] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 17:53:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:07.937384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1222078435", "imageRef": "d21769b8-84ef-4428-b1d7-4c38178f45a9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1355217158", "networks": [{"uuid": "bf563815-c843-4c46-9e6e-4b29f7c955cc"}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:07.988764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] validate_networks() for [('bf563815-c843-4c46-9e6e-4b29f7c955cc', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:08.356218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3", "tag": "d5e31f41-ce76-4380-9f14-803f75245db8"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:08.375033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.375527 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.376154 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.387393 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] Creating event network-changed:d5e31f41-ce76-4380-9f14-803f75245db8 for instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 on hv-cinder-83538 Aug 24 17:53:08.392493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-43eb1323-a74d-4837-94c0-4126fcee8712 req-20a5f26c-448a-486a-8b3e-1df75e46223c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040585 Aug 24 17:53:08.393584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 540/1095] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:08.502686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:08.503167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:08.503577 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:08.504129 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:08.504736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:08.513958 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.514480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.514919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.515788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.516252 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.516724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.538020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Getting quotas for project 2de47efc59f04643ab02651d40b77067. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:08.542726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Getting quotas for user 127dbee9996d4c9e8f8603edaa579e36 and project 2de47efc59f04643ab02651d40b77067. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:08.554918 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:08.557357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d21769b8-84ef-4428-b1d7-4c38178f45a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:08.609480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-95a395d5-b381-4e3b-ab66-4724080e0e41 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676537 Aug 24 17:53:08.610671 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 556/1096] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:53:08.621536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2d635d18-65bd-427a-955c-27b2b1ed1b70 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:08.622536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2d635d18-65bd-427a-955c-27b2b1ed1b70 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:08.694469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2d635d18-65bd-427a-955c-27b2b1ed1b70 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:08.705772 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2d635d18-65bd-427a-955c-27b2b1ed1b70 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1259 microversion: 2.1 time: 0.088274 Aug 24 17:53:08.706665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 541/1097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:08 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:09.727936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:09.729593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:09.737301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.737818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.738249 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.739250 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.739713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.740301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.805759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.816819 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9c03a729-49e6-4407-9f4c-a2c77e9c1a18 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1317 microversion: 2.1 time: 0.093055 Aug 24 17:53:09.820463 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 557/1098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:09 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.841099 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.841881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.849884 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.850377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.850812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.851517 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.851997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.852422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.991869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:10.994397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:11.001443 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-86ac96db-256e-46e3-b832-635095d5b771 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.164508 Aug 24 17:53:11.002032 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 542/1099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:12.023184 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.024738 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.027401 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:12.039056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.039835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.041441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.042365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.043854 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.044006 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.054919 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=67 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:12.198933 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:12.209081 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-33df0fc5-22a7-4f3b-b88c-6deb120d0128 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.189558 Aug 24 17:53:12.209810 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 558/1100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:13.230086 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.231852 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.235704 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:13.243299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.244518 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.245139 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.245778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.246231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.246652 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.383407 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:13.392230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2ea49c7b-9e0a-4778-bf4a-ae22eebd3a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.165778 Aug 24 17:53:13.393073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 543/1101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:14.414335 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:14.414948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:14.422309 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.423150 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.423801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.424788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.425458 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.426093 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.568649 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:14.576892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-b2fe8be6-3db4-4729-a363-f3d42af99e36 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.166067 Aug 24 17:53:14.577436 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 559/1102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:14 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:15.599590 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:15.600217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:15.606786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.607829 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.608268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.609088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.609545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.609969 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.754604 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:15.763610 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dea8378a-0c57-479c-ad0b-012fb52e2528 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.167855 Aug 24 17:53:15.765267 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 544/1103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:15 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:16.786952 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.787613 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.800207 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.800783 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.801224 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.802420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.802420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.802781 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.939756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:16.948531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-875e0675-5303-4993-afac-93ac67438962 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.165625 Aug 24 17:53:16.949128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 560/1104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:17.970079 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:17.970715 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:17.977176 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.977657 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.978095 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.978787 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.979244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.979671 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:18.103379 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:18.111024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ee65a41b-2acc-4342-aa5c-a0fab852c9fc tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.145377 Aug 24 17:53:18.111591 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 545/1105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:17 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:19.131201 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:19.131816 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:19.134125 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:19.134792 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=6 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:19.140357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.140870 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.141308 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.141996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.142447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.142869 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.275520 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:19.283635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-315f842a-ae92-47f3-8ea3-2278364ba096 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.156317 Aug 24 17:53:19.284194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 561/1106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:19 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:20.301642 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:20.306459 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.307093 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.313818 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.314297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.314729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.315633 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.316205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.316705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.566020 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:20.573938 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6c081187-6bd3-4174-8958-8e2b28c512f8 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.273285 Aug 24 17:53:20.574502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 546/1107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:20 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:20.854677 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:20.865084 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.865553 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.865977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.877299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] Creating event network-changed:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:53:20.882579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-e38db0fd-2307-42b0-9316-511a50a77043 req-212cc03d-dfd0-47b0-8f5b-d133dd76cc7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031669 Aug 24 17:53:20.883264 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 562/1108] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:21.595732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.596344 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.602732 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.603216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.603655 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.604346 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.604836 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.605268 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.735631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.743141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4a9c324e-3e0e-49a2-bb69-8b2fe91ad611 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.151863 Aug 24 17:53:21.743711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 547/1109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:22.764766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.765456 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.771579 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.772299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.772822 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.773524 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.773950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.774367 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.899185 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.907134 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-714fceaf-efe1-4cc6-8eec-7bf11c5ff0af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.147104 Aug 24 17:53:22.907689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 563/1110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:23.927397 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.928001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.934833 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.935305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.935733 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.937069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.937533 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.937952 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.066501 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:24.074066 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4123fcbc-903b-4e95-b3e4-706e617452c4 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.150591 Aug 24 17:53:24.074850 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 548/1111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:25.098735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:25.099299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:25.105664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.106149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.106590 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.107281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.107734 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.108161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.237425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:25.244996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c98edd87-d65f-4aa6-8ed0-81e1c5c7844a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.150357 Aug 24 17:53:25.245563 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 564/1112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:25 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:26.266398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.267001 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.273638 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.274115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.274550 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.275256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.275711 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.276138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.405445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:26.413065 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4912d9b7-8fe1-4b38-af0a-60438c2393af tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.150622 Aug 24 17:53:26.413627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 549/1113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:26 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.433257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.433872 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.440865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.441338 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.441766 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.442453 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.442901 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.443323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.830723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.838375 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c4e75dea-866e-4958-b13b-e7543ac29ef0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.408975 Aug 24 17:53:27.838932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 565/1114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:28.100759 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "name": "network-vif-plugged", "status": "completed", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:28.111741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.112217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.112665 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.123905 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] Creating event network-vif-plugged:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:53:28.128807 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-fa333582-eea0-4dc2-b756-cbbca3d60c2f req-83d5d28c-c502-41c5-967a-8c8534a64bda service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 Aug 24 17:53:28.129386 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 550/1115] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:28.859044 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.859651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.866070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.866540 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.866962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.867633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.868075 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.868488 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.002899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:29.010523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-df9cb009-daeb-4756-94c1-d432c830716a tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1359 microversion: 2.1 time: 0.155390 Aug 24 17:53:29.011166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 566/1116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:30.032894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.033588 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.039640 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.040120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.040572 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.041262 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.041716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.042141 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.168116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:30.176000 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0b0c0d1a-bc00-4074-af05-10174c124b38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1550 microversion: 2.1 time: 0.147900 Aug 24 17:53:30.176576 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 551/1117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:30.196503 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.197149 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.204180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.204713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.205152 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.205841 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.206291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.206711 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.335848 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:30.343944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-2a29a03f-16cd-4669-a1ef-732c9e0f31fb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1550 microversion: 2.1 time: 0.151255 Aug 24 17:53:30.344517 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 567/1118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:30.363575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.368313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:30.369044 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Searching by: {'deleted': False, 'project_id': '2de47efc59f04643ab02651d40b77067'} {{(pid=127239) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 17:53:30.375612 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.376091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.376530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.377293 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.377748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.378175 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.466765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.multi_cell_list [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127239) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 17:53:30.560863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4c03dd63-ceba-4d2b-a414-2a7ff31e2bf5 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201062 Aug 24 17:53:30.561433 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 552/1119] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:30.572743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.573351 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.579823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.580328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.580796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.581489 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.581917 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.582331 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.735574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:30.744110 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-775230ea-4997-4f33-806b-d9ffea814526 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1550 microversion: 2.1 time: 0.175241 Aug 24 17:53:30.744692 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 568/1120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:32.290765 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7cfc8fa-795d-4277-8edd-a1417bdac70a"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:32.293162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.299530 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.300005 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.300436 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.301156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.301609 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.302033 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.536220 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4277c768-dc99-4847-97ce-49698a7b6a4d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249379 Aug 24 17:53:32.536811 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 553/1121] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:53:32 2022] POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:40.102509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:40.103112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:40.109447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.109920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.110347 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.111023 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.111469 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.111884 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.241746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:40.250593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c5f768e0-7f9f-445d-aabe-daa735d07b25 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1596 microversion: 2.1 time: 0.151896 Aug 24 17:53:40.251146 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 569/1122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:40 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1596 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:41.804575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:41.810052 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:41.816922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.817399 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.817828 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.829326 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] Creating event network-changed:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:53:41.836157 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-cf79e262-f363-4455-a763-686952051b87 req-6a35464b-6e98-4e08-b3fd-9013a52f90eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035251 Aug 24 17:53:41.836667 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 554/1123] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:43.054761 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1966799387"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:43.055293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:43.057408 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=24 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:43.063409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.063896 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.064339 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.065079 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.065567 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.065999 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.069862 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=68 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:43.190148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.network.security_group_api [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Adding security group c5920f27-6808-4541-9032-cf8d7d19e33f to port 5337c880-01f6-4bc7-9677-c37e17beb648 Aug 24 17:53:43.493806 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5988b233-eb71-4474-bd78-cca6ea9a539b tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action" status: 202 len: 0 microversion: 2.1 time: 0.442844 Aug 24 17:53:43.494714 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 570/1124] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:53:43 2022] POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:43.504045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:43.505371 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:43.507375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=24 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:43.513196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.513760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.514261 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.515158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.515613 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.516043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.521631 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:43.670648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:43.678741 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-858d0b6e-ceac-420e-8e9a-db6e069d8ae3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1761 microversion: 2.1 time: 0.179451 Aug 24 17:53:43.679303 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 555/1125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:43 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:43.851168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:43.860475 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.860978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.861399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.872221 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] Creating event network-changed:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:53:43.877390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-4739e50d-6c6b-451d-afb2-483cd0ce554b req-15358935-02ff-47b5-b83b-f03cac1b1f13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029915 Aug 24 17:53:43.878148 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 571/1126] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:23.625328 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.625923 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.628195 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:23.628862 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=5 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:23.634801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.635287 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.635770 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.636534 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.637014 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.637440 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.659885 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-121ba044-f044-4db4-ae51-158853bc96b4 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/ips" status: 200 len: 144 microversion: 2.1 time: 0.038541 Aug 24 17:54:23.660441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 556/1127] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:24.985909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54e95c24-93b8-4472-85e5-6711cc295747"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:24.988287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:24.990352 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:24.991177 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=5 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:24.996796 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.997270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.997698 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.998379 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.998826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.999243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.244857 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9439502d-6203-4187-8343-1fa8fca034d8 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263072 Aug 24 17:54:25.245655 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 572/1128] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:24 2022] POST /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:54:32.780299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.782505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.788980 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.789507 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.789945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.790651 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.791646 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.792069 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.828635 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-a9105891-15aa-4824-8f67-d5ac5c586316 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052680 Aug 24 17:54:32.829471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 557/1129] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:32.841191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.841882 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.848927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.849514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.849949 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.850660 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.851111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.851532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.884261 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9829328f-a366-4ddd-b5ca-b46e2defebfe tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747" status: 200 len: 194 microversion: 2.1 time: 0.048035 Aug 24 17:54:32.885523 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 573/1130] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:34.213606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2290ae59-e2ad-424b-acac-5f9e1c3f8d53"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:34.215967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.223335 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.223819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.224277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.224985 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.225446 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.225872 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.460626 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-24950894-c56d-4e4c-afa7-fba41833b39a tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "POST /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250753 Aug 24 17:54:34.461216 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 558/1131] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:34 2022] POST /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:41.970721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:41.973025 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:41.980053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.980529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.980982 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.981665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.982115 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.982537 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.011589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-873d8497-2d58-498f-af2e-0c080156c155 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044768 Aug 24 17:54:42.012151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 574/1132] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:41 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:42.155740 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:42.156334 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:42.162421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.162906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.163340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.164024 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.164472 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.164919 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.192962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-55f0b6b5-2c25-42e5-8873-5a0b6e299f81 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747" status: 200 len: 194 microversion: 2.1 time: 0.041961 Aug 24 17:54:42.193526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 559/1133] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 24 17:54:42 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:42.204117 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:42.204638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:42.210464 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.210942 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.211369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.212735 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.213191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.213609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.293281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lazy-loading 'services' on Instance uuid 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:42.363411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ca594bf5-686c-48e1-88fb-8c24bbc3b537 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747" status: 202 len: 0 microversion: 2.1 time: 0.163014 Aug 24 17:54:42.364078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 575/1134] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:54:42 2022] DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/54e95c24-93b8-4472-85e5-6711cc295747 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:43.480713 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.481200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.487403 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.487876 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.488307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.489013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.489470 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.489897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.519367 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-12e8c66c-e1b9-4d63-a6b6-12c0c0dc858f tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/2290ae59-e2ad-424b-acac-5f9e1c3f8d53" status: 200 len: 194 microversion: 2.1 time: 0.043069 Aug 24 17:54:43.519931 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 560/1135] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 24 17:54:43 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/2290ae59-e2ad-424b-acac-5f9e1c3f8d53 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:43.531333 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.531945 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.538096 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.538580 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.539017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.539736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.540344 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.541024 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.619632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lazy-loading 'services' on Instance uuid 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:43.689092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-eee490cf-8f79-4af0-a99b-142e3fbc55a1 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/2290ae59-e2ad-424b-acac-5f9e1c3f8d53" status: 202 len: 0 microversion: 2.1 time: 0.162358 Aug 24 17:54:43.689609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 576/1136] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:54:43 2022] DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments/2290ae59-e2ad-424b-acac-5f9e1c3f8d53 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:44.858230 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:44.860475 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.866927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.867421 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.868364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.869092 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.869551 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.869978 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.898927 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3b569a9b-a44f-4f68-b1c0-79319cf45ed6 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044610 Aug 24 17:54:44.899502 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 561/1137] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:44 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:54:45.011342 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:45.013652 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:45.019997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.020470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.020939 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.021619 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.022070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.022487 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.049997 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5fd26d5b-73ad-49cb-af86-8b0fa206d561 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044084 Aug 24 17:54:45.050568 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 577/1138] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:45 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:54:45.110255 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:45.110754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:45.116675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.117158 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.117595 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.118812 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.119251 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.119682 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.144543 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Going to try to terminate instance {{(pid=127239) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:54:45.223177 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-3f5fa71e-0dbf-4e88-8a71-b680e5764b52 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 204 len: 0 microversion: 2.1 time: 0.116335 Aug 24 17:54:45.223992 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 562/1139] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:45 2022] DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:45.232760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:45.233395 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:45.239161 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.239632 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.240060 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.240776 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.241226 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.241643 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.370996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:45.378507 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7ac69701-66aa-4d1c-9014-aa3b25f18c1c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1671 microversion: 2.1 time: 0.149691 Aug 24 17:54:45.379061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 578/1140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:45 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:46.399898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:46.400615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:46.407018 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:46.407489 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:46.407917 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.408681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:46.409132 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:46.409548 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.540778 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:46.548491 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-81a43eb7-2360-4e8c-99e7-8e1255d9e01c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1671 microversion: 2.1 time: 0.152904 Aug 24 17:54:46.549085 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 563/1141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:46 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:47.570231 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:47.571476 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:47.578078 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.578570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.578978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.579686 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.580112 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.580536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.823486 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58652b0d60ec4134be18dafeb7ad5cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c39bcd24354fd5b79179c48abc07f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:47.831525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5d17c543-1e5d-4125-8658-fa2f95b732e3 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 200 len: 1671 microversion: 2.1 time: 0.265208 Aug 24 17:54:47.832106 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 579/1142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:47 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:48.009894 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3", "name": "network-vif-deleted", "tag": "d5e31f41-ce76-4380-9f14-803f75245db8"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:48.024649 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.025730 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.026431 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.040752 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] Creating event network-vif-deleted:d5e31f41-ce76-4380-9f14-803f75245db8 for instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 on hv-cinder-83538 Aug 24 17:54:48.046729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-4b0d6041-86a6-4c79-90ff-31b9345656ca req-1c1159e8-1100-46b5-b6ac-c997a90bff2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040818 Aug 24 17:54:48.047435 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 564/1143] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:48.853992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.854638 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.861139 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.861627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.862068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.862787 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.863225 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.863651 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.877880 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 HTTP/1.1 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:54:48.879571 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:48.881299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3'} Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:48.882399 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:48.884035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.886102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:48.886102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-05b78c60-2412-49cc-868e-53fca8908400 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 404 len: 111 microversion: 2.1 time: 0.031617 Aug 24 17:54:48.886102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 580/1144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:48.890725 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0b0c5fe9-6f18-4447-b4f3-bed5321bb2ab tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '.version_select at 0x7fa666d91700>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.910363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0b0c5fe9-6f18-4447-b4f3-bed5321bb2ab tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-108104033" status: 202 len: 0 microversion: 2.1 time: 0.023985 Aug 24 17:54:48.910999 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 565/1145] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 17:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-108104033 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:51.774654 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:51.775180 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:51.781547 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.782020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.782446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.783126 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.783575 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.783993 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.798420 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 HTTP/1.1 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:54:51.799960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.801369 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': '13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3'} Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:51.803526 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.805527 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.806863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:51.806863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e6539645-cfae-4102-bfaa-6b449c6149fc tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 404 len: 111 microversion: 2.1 time: 0.030505 Aug 24 17:54:51.806863 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 581/1146] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:51 2022] DELETE /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:51.810842 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:51.811579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:51.818121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.818597 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.819034 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.819718 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.820178 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.821272 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.834166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 HTTP/1.1 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:54:51.835771 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.837391 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3'} Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:51.838232 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. Aug 24 17:54:51.839680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:51.841013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance 13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:51.841013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e1133739-79a1-4d4c-b78e-70aae188e09c tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3" status: 404 len: 111 microversion: 2.1 time: 0.030653 Aug 24 17:54:51.841013 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 566/1147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:51 2022] GET /compute/v2.1/servers/13b3e4da-ca42-4b74-88f9-ddd7efcdd0b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:52.972678 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:52.973157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:52.979608 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.980074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.980500 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.981233 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.981679 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.982095 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.995036 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 HTTP/1.1 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:54:52.996572 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:52.998157 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'e0880267-479d-47c2-ac80-3061e1857262'} Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:52.999057 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.000509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.002088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:53.002088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d944a091-0c8d-4378-82d9-5d6f07da0735 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 404 len: 111 microversion: 2.1 time: 0.029110 Aug 24 17:54:53.002088 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 582/1148] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:52 2022] DELETE /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:53.007200 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:53.008351 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] [instance: e0880267-479d-47c2-ac80-3061e1857262] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:53.015104 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:53.015575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:53.016003 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:53.016717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:53.017163 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:53.017578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:53.031056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] HTTP exception thrown: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Request method failure captured: Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 HTTP/1.1 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmQo_xViJpfQlv6hsRB9gkOWQIaSoMCE1Xv5XagBe2MUlDEI1-dJrUTvw20RDhguHrbG07hSm8IYtfHSbUIt15nNl6qiMOH7h6-QWqyKN5Wua5kz9pnrmmyklMuKCIAa0PMqMlCOk4S0gEcIcIF209OJhcZ4iQPWEK36C9wu-aY_PHs Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:54:53.032589 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/75c39bcd24354fd5b79179c48abc07f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 75c39bcd24354fd5b79179c48abc07f1 Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-AttachVolumeTestJSON-543898436 Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 58652b0d60ec4134be18dafeb7ad5cb0 Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-AttachVolumeTestJSON-543898436-project Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.034205 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': 'e0880267-479d-47c2-ac80-3061e1857262'} Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:53.035117 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. Aug 24 17:54:53.036618 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:54:53.038062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] Returning 404 to user: Instance e0880267-479d-47c2-ac80-3061e1857262 could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:53.038062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-b3895910-e058-42bb-8457-a8ddfc1a45e9 tempest-AttachVolumeTestJSON-543898436 tempest-AttachVolumeTestJSON-543898436-project] 10.222.0.45 "GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262" status: 404 len: 111 microversion: 2.1 time: 0.030498 Aug 24 17:54:53.038062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 567/1149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:53 2022] GET /compute/v2.1/servers/e0880267-479d-47c2-ac80-3061e1857262 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:54.762070 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:54.764504 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:54.771480 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.771957 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.772383 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.775699 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.776615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.777265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.853886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-78bd636d-911c-408d-a5f9-ae39666f3006 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action" status: 202 len: 0 microversion: 2.1 time: 0.096083 Aug 24 17:54:54.855067 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 583/1150] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:54:54 2022] POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:54.866076 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:54.866882 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:54.870219 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:54.877708 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.878491 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.878983 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.879687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.880179 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.880648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.889965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:55.236757 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.245648 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-f577afbd-250e-4b0c-b962-ca5f37eea684 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1753 microversion: 2.1 time: 0.385748 Aug 24 17:54:55.246217 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 568/1151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:54 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1753 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:56.274664 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:56.275362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:56.277301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=25 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:56.283419 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.283906 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.284341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.285069 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.285559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.285985 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.309204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:56.457998 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:56.466842 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8d2118dc-a8d2-4585-b61f-f376bc5cb9c9 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.196997 Aug 24 17:54:56.467447 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 584/1152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:56 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:57.489120 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:57.489731 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:57.496251 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.496772 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.497208 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.500932 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.501448 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.501891 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.653859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:57.662222 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7fa6ead9-fc80-4355-b55d-2e921cc5c3a0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.176967 Aug 24 17:54:57.662789 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 569/1153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:57 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:58.684795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:58.686008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:58.697513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.697513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.697513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:58.698545 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.699446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.700038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:58.848944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:58.857930 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-4a4e0cd4-8b34-490f-824f-1c57dad8ab38 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.178139 Aug 24 17:54:58.858607 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 585/1154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:58 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:59.880630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:59.881493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:59.889505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:59.889996 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:59.890429 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:59.891131 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:59.891584 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:59.892008 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.046702 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.055505 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0469c1b6-c95b-4fc9-a3fe-13153a776a5f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.179593 Aug 24 17:55:00.056080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 570/1155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:59 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:01.077186 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:01.077797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:01.084130 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.084633 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.085068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.086364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.086899 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.087213 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.242534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:01.250788 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-3765293e-1ac2-42b3-acc5-5e3addf5a727 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.177596 Aug 24 17:55:01.251359 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 586/1156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:01 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:02.273497 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:02.274254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:02.280931 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.281410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.281846 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.282536 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.282989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.283410 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.437924 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.448382 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2e38affe-b880-45dc-ace8-e1daf46db12c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.178886 Aug 24 17:55:02.448984 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 571/1157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:02 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:03.469723 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:03.470328 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:03.477363 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.477839 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.478265 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.478940 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.479384 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.479797 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.619543 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:03.627615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c7c8d923-5099-4bb0-a1cf-6d70e6283aaa tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.161869 Aug 24 17:55:03.628165 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 587/1158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:03 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:04.649161 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:04.649779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:04.656110 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.656628 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.657074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.657764 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.658221 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.658650 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.798529 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.807666 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2e8545c2-97d3-461c-bc42-9495b439985f tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.162297 Aug 24 17:55:04.808242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 572/1159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:04 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:05.828764 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:05.829438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:05.837197 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.837774 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.838305 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.839167 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.839618 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.840163 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.979760 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:05.987996 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-68495dee-cb8f-48d5-a1ab-1f150842fbef tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.163314 Aug 24 17:55:05.988574 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 588/1160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:05 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:07.008935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:07.009547 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:07.016256 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.016783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.017219 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.017904 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.018358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.018783 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.155015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:07.163866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-9a3e1c0b-5163-4816-a14b-8fd55996646e tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.158310 Aug 24 17:55:07.164428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 573/1161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:07 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:08.184597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:08.185204 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:08.191562 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:08.192039 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:08.192470 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:08.193179 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:08.193630 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:08.194053 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:08.340472 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:08.348756 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-a8f0c840-6b3c-4693-9dbc-69505154c3cd tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.167976 Aug 24 17:55:08.349365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 589/1162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:08 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:09.369726 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:09.370358 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:09.376641 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:09.377115 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:09.377545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:09.378218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:09.378667 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:09.379082 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:09.518087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:09.526819 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-179f315a-79f6-46db-8b2e-c3b54eff85bb tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1758 microversion: 2.1 time: 0.160993 Aug 24 17:55:09.527369 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 574/1163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:09 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:10.547156 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:10.547853 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:10.555206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.555206 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.555409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.555921 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.556365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.556801 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.702449 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:10.710995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d4cc6a08-e002-4cab-ae97-05d04f1a2ce0 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1761 microversion: 2.1 time: 0.167654 Aug 24 17:55:10.711567 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 590/1164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:10 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:27.381282 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:55:27.381962 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Wed Aug 24 17:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:55:30.528628 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 24 17:56:14.235164 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=13 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:14.235903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=41 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:14.241026 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1966799387"}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:14.241737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:14.248424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.248844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.249270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.249942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.250377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.250802 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.535022 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.network.security_group_api [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Removing security group c5920f27-6808-4541-9032-cf8d7d19e33f from port 5337c880-01f6-4bc7-9677-c37e17beb648 Aug 24 17:56:14.939386 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-e0dba0b9-0019-488c-bb5b-1cd06b4cb18d tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action" status: 202 len: 0 microversion: 2.1 time: 0.705781 Aug 24 17:56:14.940245 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 575/1165] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 17:56:14 2022] POST /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:14.966362 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=13 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:14.967730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=41 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:15.161827 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:15.177601 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:15.178351 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:15.178952 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:15.195687 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] Creating event network-changed:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:56:15.203750 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-3535830e-d9d3-460b-a413-07e0d0118ffd req-2d241239-b664-4ffd-8f93-f04840ebc63f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239141 Aug 24 17:56:15.204936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 591/1166] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:16.704977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:16.705473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:16.712215 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:16.712663 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:16.713096 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:16.714010 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:16.714461 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:16.714881 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:16.805242 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lazy-loading 'services' on Instance uuid d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:16.886773 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-1d5e94e5-feb1-476a-9f4c-4da5f8e0ec66 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments/e7cfc8fa-795d-4277-8edd-a1417bdac70a" status: 202 len: 0 microversion: 2.1 time: 0.186996 Aug 24 17:56:16.887450 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 576/1167] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:56:16 2022] DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments/e7cfc8fa-795d-4277-8edd-a1417bdac70a => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:16.897555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:16.900194 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:16.909587 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:16.910739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:16.911790 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:16.912636 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:16.913468 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:16.914092 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:16.969174 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-5a0c4460-0c20-4d06-b10f-82f0e0569e35 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076463 Aug 24 17:56:16.970119 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 592/1168] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:16 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:17.513464 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:17.524613 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:17.525363 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:17.525786 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:17.538251 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] Creating event network-changed:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:56:17.543308 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-7a4a9fcc-762e-4645-a13b-de2d72372b77 req-2588e77c-355b-4f73-b558-750542a5ae03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034661 Aug 24 17:56:17.543896 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 577/1169] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:17.982531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:17.984891 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:17.991791 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:17.992393 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:17.992961 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:17.993733 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:17.994278 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:17.994914 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.030033 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-387c21be-4902-45a7-9a72-babcde19dcfe tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051617 Aug 24 17:56:18.030737 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 593/1170] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:17 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:56:18.042570 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:18.043156 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:18.051427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.051913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.052540 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.054045 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.054662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.055254 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.144909 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] HTTP exception thrown: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 is not attached to volume e7cfc8fa-795d-4277-8edd-a1417bdac70a Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Request method failure captured: Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments/e7cfc8fa-795d-4277-8edd-a1417bdac70a HTTP/1.1 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmVzcxN1DaoVziVFHF-yzpo_P2UilnG48Qxw-8Vu2h5-P3i2cl91kYJl3IUf4yvX438bVadSQveAzlYKEC68BUcRUhiwZatxXWp-r5a5Z3O9rSpDAvNr5VQ6vD2ARHZxDfHzvWKLzxjyCutmEGWNtCDDWQhkQ6UeuyO18t1qmphopJ0 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 2de47efc59f04643ab02651d40b77067 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:56:18.148062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2de47efc59f04643ab02651d40b77067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2de47efc59f04643ab02651d40b77067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2de47efc59f04643ab02651d40b77067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2de47efc59f04643ab02651d40b77067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 2de47efc59f04643ab02651d40b77067 Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-TestMinimumBasicScenario-1831466008-project Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: 127dbee9996d4c9e8f8603edaa579e36 Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-TestMinimumBasicScenario-1831466008-project Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:56:18.149679 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 is not attached to volume e7cfc8fa-795d-4277-8edd-a1417bdac70a Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'server_id': 'd7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0', 'id': 'e7cfc8fa-795d-4277-8edd-a1417bdac70a'} Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7cfc8fa-795d-4277-8edd-a1417bdac70a. Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:18.150509 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 is not attached to volume e7cfc8fa-795d-4277-8edd-a1417bdac70a Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 is not attached to volume e7cfc8fa-795d-4277-8edd-a1417bdac70a Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.154989 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Returning 404 to user: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 is not attached to volume e7cfc8fa-795d-4277-8edd-a1417bdac70a {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:18.156427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6b98d7ad-ad54-48f7-a474-44a9c6f745a3 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments/e7cfc8fa-795d-4277-8edd-a1417bdac70a" status: 404 len: 154 microversion: 2.1 time: 0.112453 Aug 24 17:56:18.156427 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 578/1171] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:56:18 2022] DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0/os-volume_attachments/e7cfc8fa-795d-4277-8edd-a1417bdac70a => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.306927 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.307496 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.313960 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.314513 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.315017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.315795 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.316315 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.316834 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.343241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:56:19.380114 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1986905140", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "networks": [{"uuid": "2a85c3b4-e8ac-4841-82b4-13225432ed01"}]}} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:19.419978 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-32d560f8-5ea6-40cd-aca7-0422345179e2 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 204 len: 0 microversion: 2.1 time: 0.116876 Aug 24 17:56:19.424232 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 594/1172] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:19 2022] DELETE /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:56:19.429812 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.429920 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.435727 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.436211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.436676 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.437371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.437821 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.438245 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.439953 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.network.neutron [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] validate_networks() for [('2a85c3b4-e8ac-4841-82b4-13225432ed01', None, None, None, None, None)] {{(pid=127239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:56:19.770946 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:19.780483 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6105cb4a-2484-4aaa-b329-88482ae2fac1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1556 microversion: 2.1 time: 0.355446 Aug 24 17:56:19.781090 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 595/1173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:19 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1556 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:19.868036 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Flavor limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:56:19.868453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Image limits 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:56:19.868958 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Flavor pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:56:19.869364 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Image pref 0:0:0 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:56:19.869767 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.virt.hardware [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:56:19.878333 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.878806 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.879231 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.879941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.880394 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.881417 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.898420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Getting quotas for project 0a389d974a9c465f8f5a8204b77be62b. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:56:19.902289 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.quota [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Getting quotas for user fa2df13f963549078f92b91cf21da2f0 and project 0a389d974a9c465f8f5a8204b77be62b. Resources: {'instances', 'cores', 'ram'} {{(pid=127239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:56:19.912856 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Going to run 1 instances... {{(pid=127239) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:56:19.915080 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:56:19.961473 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-667362c6-3f3e-4d03-91eb-407897eec5c6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585122 Aug 24 17:56:19.962113 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 579/1174] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:56:19.972786 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f3ad7632-4f74-498b-bd9c-8344a0d0332a tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.973404 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f3ad7632-4f74-498b-bd9c-8344a0d0332a tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:20.026058 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f3ad7632-4f74-498b-bd9c-8344a0d0332a tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:20.032865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f3ad7632-4f74-498b-bd9c-8344a0d0332a tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1219 microversion: 2.1 time: 0.063943 Aug 24 17:56:20.033435 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 596/1175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:19 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:20.805800 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:20.806420 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:20.813313 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.813793 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.814424 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:20.815121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.815575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.815997 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:20.951180 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:20.960041 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4030fb66-d40c-48e1-906a-f7ab46225a3c tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1556 microversion: 2.1 time: 0.161028 Aug 24 17:56:20.960628 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 580/1176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:20 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:21.052724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:21.053277 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:21.062035 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.062505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.062932 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.063614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.064056 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.064471 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.123894 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:21.132627 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-ae326df5-0188-4ed8-8e6c-3fb42b2845fa tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1271 microversion: 2.1 time: 0.083822 Aug 24 17:56:21.133181 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 597/1177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:21 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:21.981697 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:21.982340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:21.988749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.989239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.989678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.991015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.991469 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.992079 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:22.153937 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:22.154556 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:22.161612 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:22.162739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:22.163169 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:22.163877 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:22.164311 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:22.164754 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:22.355866 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127dbee9996d4c9e8f8603edaa579e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de47efc59f04643ab02651d40b77067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:22.363675 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cd2c1da5-223a-4aaf-b0dd-8e140b0a4369 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 200 len: 1514 microversion: 2.1 time: 0.385961 Aug 24 17:56:22.364241 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 581/1178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:21 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:22.412531 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:22.427825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6c464e09-aed8-4aa8-917b-47fc46d4ee6e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1277 microversion: 2.1 time: 0.277387 Aug 24 17:56:22.429310 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 598/1179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:22 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:56:22.477709 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0", "name": "network-vif-deleted", "tag": "5337c880-01f6-4bc7-9677-c37e17beb648"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:22.490705 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:22.491182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:22.491606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:22.507250 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] Creating event network-vif-deleted:5337c880-01f6-4bc7-9677-c37e17beb648 for instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 on hv-cinder-83538 Aug 24 17:56:22.513895 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-a5126c45-6979-4f30-9a0b-7567ad1c02a5 req-852d202f-532c-40d7-8dfd-0ae8e2c36c3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039820 Aug 24 17:56:22.514962 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 582/1180] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:23.385366 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:23.385974 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] [instance: d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:23.393131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:23.393614 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:23.394048 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:23.394741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:23.395188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:23.395609 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:23.408778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.wsgi [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] HTTP exception thrown: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Request method failure captured: Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: request: GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 HTTP/1.1 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept: application/json Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Accept-Encoding: identity Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Connection: close Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Length: 0 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Content-Type: application/json Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Host: 10.222.0.45 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Openstack-System-Scope: None Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Auth-Token: gAAAAABjBmVzcxN1DaoVziVFHF-yzpo_P2UilnG48Qxw-8Vu2h5-P3i2cl91kYJl3IUf4yvX438bVadSQveAzlYKEC68BUcRUhiwZatxXWp-r5a5Z3O9rSpDAvNr5VQ6vD2ARHZxDfHzvWKLzxjyCutmEGWNtCDDWQhkQ6UeuyO18t1qmphopJ0 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Id: None Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Domain-Name: None Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Identity-Status: Confirmed Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Is-Admin-Project: True Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Id: default Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Domain-Name: Default Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Id: 2de47efc59f04643ab02651d40b77067 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Project-Name: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Role: reader,member Aug 24 17:56:23.410438 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Roles: reader,member Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2de47efc59f04643ab02651d40b77067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2de47efc59f04643ab02651d40b77067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2de47efc59f04643ab02651d40b77067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2de47efc59f04643ab02651d40b77067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Id: 2de47efc59f04643ab02651d40b77067 Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1831466008 Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User: tempest-TestMinimumBasicScenario-1831466008-project Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Id: default Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Domain-Name: Default Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Id: 127dbee9996d4c9e8f8603edaa579e36 Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: X-User-Name: tempest-TestMinimumBasicScenario-1831466008-project Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: method: > Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: exception: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. Aug 24 17:56:23.412510 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: action_args: {'id': 'd7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0'} Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:23.417038 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. Aug 24 17:56:23.418867 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR nova.api.openstack.wsgi Aug 24 17:56:23.420205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Returning 404 to user: Instance d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 could not be found. {{(pid=127241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:23.420205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-c1ca8d4a-3dab-441a-a9b3-84844f9954db tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0" status: 404 len: 111 microversion: 2.1 time: 0.030659 Aug 24 17:56:23.420205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 599/1181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:23 2022] GET /compute/v2.1/servers/d7cecfb0-e65b-43a8-8b92-b1ee89eeb7d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:23.421869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4a5105c9-f451-43b0-aa66-4d4204e58cb1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] Calling method '.version_select at 0x7fa666eeb310>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:23.441088 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4a5105c9-f451-43b0-aa66-4d4204e58cb1 tempest-TestMinimumBasicScenario-1831466008 tempest-TestMinimumBasicScenario-1831466008-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1355217158" status: 202 len: 0 microversion: 2.1 time: 0.023455 Aug 24 17:56:23.441660 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 583/1182] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Aug 24 17:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1355217158 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:23.449589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:23.450211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:23.456061 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:23.456534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:23.457183 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:23.457875 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:23.458323 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:23.458954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:23.740892 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:23.749431 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-61ce7f79-d072-4579-af5f-bb786b1f92b4 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.303698 Aug 24 17:56:23.749995 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 600/1183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:23 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:24.544823 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91388e87-dcb2-4040-89d1-596d8bd5594e", "tag": "989fb732-9427-48bb-bd54-9349d2dccb20"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:24.555017 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.555485 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.555906 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.566061 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] Creating event network-changed:989fb732-9427-48bb-bd54-9349d2dccb20 for instance 91388e87-dcb2-4040-89d1-596d8bd5594e on hv-cinder-83538 Aug 24 17:56:24.571549 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-103a5f28-042c-4b59-ab60-2fd8248033cd req-bd9cb19a-ffe5-4ce0-b95e-23327d0631cc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Aug 24 17:56:24.572184 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 584/1184] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:24.769689 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:24.770416 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:24.779188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.779680 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.780111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.780838 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.781736 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.782166 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.963782 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:24.972332 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-be56a040-608a-4f62-901e-d491d8766a7b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.206486 Aug 24 17:56:24.972936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 601/1185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:24 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:25.994453 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:25.995225 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:26.008260 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:26.010504 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:26.011116 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:26.014309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:26.014804 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:26.016945 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:26.267948 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:26.276291 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-ed23fedd-e05f-43a3-a9a6-26d15b9c9cff tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.286808 Aug 24 17:56:26.277218 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 585/1186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:25 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:27.297411 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:27.297954 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:27.304296 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.304817 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.305257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.305948 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.306400 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.306831 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.445242 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:27.454355 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e8603733-7041-4bd8-ace6-08c13775a194 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.160844 Aug 24 17:56:27.455235 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 602/1187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:27 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:28.477087 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:28.477754 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:28.483832 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:28.484381 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:28.484925 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:28.485662 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:28.486121 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:28.486546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:28.618840 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:28.629578 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-0d9d4b2e-5b5a-4faf-8b16-bb604dd3f6db tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.156195 Aug 24 17:56:28.630601 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 586/1188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:28 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:29.393562 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91388e87-dcb2-4040-89d1-596d8bd5594e", "name": "network-vif-plugged", "status": "completed", "tag": "989fb732-9427-48bb-bd54-9349d2dccb20"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:29.406755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:29.407514 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:29.408008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:29.419409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] Creating event network-vif-plugged:989fb732-9427-48bb-bd54-9349d2dccb20 for instance 91388e87-dcb2-4040-89d1-596d8bd5594e on hv-cinder-83538 Aug 24 17:56:29.426789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-8dc455f9-98b6-4bc0-a056-50d25a79bb5a req-11ff6dca-6f06-45c8-a482-cb8cae2242cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036222 Aug 24 17:56:29.427511 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 603/1189] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:29.651015 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:29.651729 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:29.658687 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:29.659248 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:29.659897 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:29.660848 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:29.661298 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:29.661724 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:29.890627 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=2 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:29.909148 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=6 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:30.166967 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:30.175863 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-434f0e9e-535e-4033-8f73-0b3d3cd03031 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.528677 Aug 24 17:56:30.176441 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 587/1190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:29 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:31.198440 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:31.199244 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:31.201536 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:31.208128 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:31.208639 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:31.209068 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:31.209755 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:31.210559 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:31.211446 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:31.363597 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:31.372287 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-8db313c3-c213-4fb5-a2a8-e5f3b3a531cb tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1319 microversion: 2.1 time: 0.178450 Aug 24 17:56:31.373082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 604/1191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:31 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:32.394606 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:32.395210 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:32.402167 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.402639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.403074 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.403749 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.404196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.404639 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.529057 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:32.536653 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-2b5bba89-3a2a-4d47-917c-1004b94f3ba6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1509 microversion: 2.1 time: 0.145927 Aug 24 17:56:32.537214 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 588/1192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:32 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:53.995824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15f1ac02-e069-45f8-a329-d7357bd4ffb1", "device": "/dev/sdb"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:53.998724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:54.000902 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:54.001598 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:54.008188 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:54.008969 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:54.009239 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:54.009824 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:54.010257 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:54.010778 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:54.248017 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-1fe5ee41-c2e5-46d7-a8c1-4a2bb72971bf tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "POST /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256055 Aug 24 17:56:54.248814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 605/1193] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:56:53 2022] POST /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:19.934613 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:19.935107 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:19.937275 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:19.938068 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:19.944463 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:19.944979 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:19.945422 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:19.946118 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:19.946575 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:19.947003 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:20.028779 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lazy-loading 'services' on Instance uuid 91388e87-dcb2-4040-89d1-596d8bd5594e {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:57:20.098493 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-cd20565d-0313-4b81-b421-fe49e0378537 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "DELETE /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e/os-volume_attachments/15f1ac02-e069-45f8-a329-d7357bd4ffb1" status: 202 len: 0 microversion: 2.1 time: 0.167565 Aug 24 17:57:20.099073 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 589/1194] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:57:19 2022] DELETE /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e/os-volume_attachments/15f1ac02-e069-45f8-a329-d7357bd4ffb1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:57:21.218963 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:21.219570 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:21.222029 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:21.222724 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:21.228851 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.229326 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.229753 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.230441 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.230893 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.231314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.257529 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:57:21.332004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-58f7fa22-0e79-4d3a-b279-cc6b2560a3c0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "DELETE /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 204 len: 0 microversion: 2.1 time: 0.116789 Aug 24 17:57:21.332908 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 606/1195] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:57:21 2022] DELETE /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:57:21.342568 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:21.343270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:21.349526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.350006 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.350471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.351165 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.351622 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.352048 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.485359 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:21.493494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-4523bc52-a9bd-43ad-a31d-e679fc9087c7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1515 microversion: 2.1 time: 0.155790 Aug 24 17:57:21.494059 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 590/1196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:21 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:22.515743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:22.516432 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:22.523314 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:22.523809 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:22.524237 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:22.524947 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:22.525390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:22.525805 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:22.651168 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:22.658814 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-674cc4fb-d6c5-4418-8c04-2dd550ef99b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1515 microversion: 2.1 time: 0.147325 Aug 24 17:57:22.659372 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 607/1197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:22 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:23.572623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91388e87-dcb2-4040-89d1-596d8bd5594e", "name": "network-vif-deleted", "tag": "989fb732-9427-48bb-bd54-9349d2dccb20"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:23.583144 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:23.583624 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:23.584055 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:23.595071 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] Creating event network-vif-deleted:989fb732-9427-48bb-bd54-9349d2dccb20 for instance 91388e87-dcb2-4040-89d1-596d8bd5594e on hv-cinder-83538 Aug 24 17:57:23.600350 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-5590e56e-af8b-41ac-8243-46a79e9a2eda req-446a674a-4c49-4ab3-98ac-276d6ca727a9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031468 Aug 24 17:57:23.600965 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 591/1198] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:23.680191 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:23.680845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:23.687228 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:23.687702 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:23.688131 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:23.688845 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:23.689299 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:23.689721 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:23.719823 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:23.720292 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:23.720759 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:23.721202 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lazy-loading 'fault' on Instance uuid 91388e87-dcb2-4040-89d1-596d8bd5594e {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:57:23.761936 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:23.769478 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-e3630d5f-6329-4b57-afc3-d21cdf1497d0 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 200 len: 1309 microversion: 2.1 time: 0.093404 Aug 24 17:57:23.770593 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 608/1199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:23 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:24.791428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:24.792130 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 91388e87-dcb2-4040-89d1-596d8bd5594e] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:24.798330 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:24.798809 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:24.799244 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:24.799942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:24.800396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:24.800859 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:24.813901 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] HTTP exception thrown: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Request method failure captured: Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e HTTP/1.1 Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmZBwX_rjb291mHs45IvwoZ2ylf3aEpkDwLI_JV_B3vhe4DG-qWKAzYbag35JHyhNQabzgKn_rbY_f8Sosg7qOqVG1fZfmnLX-rdvKFG1bAJZbzPJhn7me6utSmalbAIzDznxpksX9ZWJq1FKGYLLyk_zuwd_aDPrZ2CP5KWvRoMSlc Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 0a389d974a9c465f8f5a8204b77be62b Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:57:24.815520 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 0a389d974a9c465f8f5a8204b77be62b Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesSnapshotTestJSON-1457338015-project Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: fa2df13f963549078f92b91cf21da2f0 Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesSnapshotTestJSON-1457338015-project Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. Aug 24 17:57:24.817865 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '91388e87-dcb2-4040-89d1-596d8bd5594e'} Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:57:24.818922 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. Aug 24 17:57:24.820621 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:57:24.821994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Returning 404 to user: Instance 91388e87-dcb2-4040-89d1-596d8bd5594e could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:57:24.821994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-082d858d-0e96-4c6b-8d91-2fe7fb4885b6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e" status: 404 len: 111 microversion: 2.1 time: 0.030192 Aug 24 17:57:24.821994 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 592/1200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:24 2022] GET /compute/v2.1/servers/91388e87-dcb2-4040-89d1-596d8bd5594e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:57:34.687992 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1367119750", "imageRef": "5b0e1c59-59b0-4f4b-b592-be8230ba0068", "flavorRef": "452", "networks": [{"uuid": "2a85c3b4-e8ac-4841-82b4-13225432ed01"}]}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:34.696466 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:34.697140 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:34.743494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.network.neutron [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] validate_networks() for [('2a85c3b4-e8ac-4841-82b4-13225432ed01', None, None, None, None, None)] {{(pid=127241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:57:35.077944 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Flavor limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:57:35.078365 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Image limits 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:57:35.078835 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Flavor pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:57:35.079243 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Image pref 0:0:0 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:57:35.079650 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.virt.hardware [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:57:35.088889 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:35.089360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:35.089789 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:35.090505 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:35.090951 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:35.091371 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:35.108301 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Getting quotas for project 0a389d974a9c465f8f5a8204b77be62b. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:57:35.112145 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.quota [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Getting quotas for user fa2df13f963549078f92b91cf21da2f0 and project 0a389d974a9c465f8f5a8204b77be62b. Resources: {'instances', 'cores', 'ram'} {{(pid=127241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:57:35.123263 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Going to run 1 instances... {{(pid=127241) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:57:35.125569 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b0e1c59-59b0-4f4b-b592-be8230ba0068',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:57:35.169004 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [4ef3c6aa-8406-4997-ae99-429e1389fe3e] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:57:36.175972 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [4ef3c6aa-8406-4997-ae99-429e1389fe3e] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41064. Aug 24 17:57:36.179886 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-af14794a-5401-4c63-b957-09fa0ff2cc2f tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495710 Aug 24 17:57:36.180532 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 609/1201] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 17:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:57:36.191808 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-8d636793-3f18-4d32-a7f1-dc3e23b3cfe6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:36.192423 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-8d636793-3f18-4d32-a7f1-dc3e23b3cfe6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:36.194545 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=8 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:36.195196 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:36.248762 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-8d636793-3f18-4d32-a7f1-dc3e23b3cfe6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:36.255556 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-8d636793-3f18-4d32-a7f1-dc3e23b3cfe6 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1219 microversion: 2.1 time: 0.068213 Aug 24 17:57:36.256411 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 593/1202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:36 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:37.277102 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-6d1cbd2f-b985-4ea8-9ac4-bb3695fa7421 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:37.277713 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-6d1cbd2f-b985-4ea8-9ac4-bb3695fa7421 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:37.332715 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-6d1cbd2f-b985-4ea8-9ac4-bb3695fa7421 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:37.340425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-6d1cbd2f-b985-4ea8-9ac4-bb3695fa7421 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1219 microversion: 2.1 time: 0.067792 Aug 24 17:57:37.341021 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 610/1203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:37 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:38.360445 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-022b6824-69c2-417a-91dd-68b729c40916 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:38.361126 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-022b6824-69c2-417a-91dd-68b729c40916 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:38.419514 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-022b6824-69c2-417a-91dd-68b729c40916 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:38.426277 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-022b6824-69c2-417a-91dd-68b729c40916 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1219 microversion: 2.1 time: 0.069612 Aug 24 17:57:38.426844 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 594/1204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:38 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:39.446826 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-dfedf935-2ea7-4391-a69d-9b0945bee905 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:39.447555 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-dfedf935-2ea7-4391-a69d-9b0945bee905 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:39.500008 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-dfedf935-2ea7-4391-a69d-9b0945bee905 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:39.507211 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-dfedf935-2ea7-4391-a69d-9b0945bee905 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1219 microversion: 2.1 time: 0.064290 Aug 24 17:57:39.507961 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 611/1205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:39 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:40.527307 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:40.527920 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:40.534257 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:40.534734 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:40.535170 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:40.535853 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:40.536311 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:40.536768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:40.596239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:40.604396 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-fc93a0d8-86f2-4686-8589-e461a652570e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1223 microversion: 2.1 time: 0.080996 Aug 24 17:57:40.605172 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 595/1206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:40 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:41.626111 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:41.626719 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:41.636578 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:41.637082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:41.637516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:41.638214 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:41.638665 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:41.639089 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:41.813289 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:41.821743 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-9512a104-8978-4613-a8a5-60530152eac7 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.199937 Aug 24 17:57:41.822391 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 612/1207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:41 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:42.365306 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc", "tag": "cd803fc8-d114-4285-82b7-7e1b8c4a5ba8"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:42.375479 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:42.376042 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:42.376681 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:42.388223 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] Creating event network-changed:cd803fc8-d114-4285-82b7-7e1b8c4a5ba8 for instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc on hv-cinder-83538 Aug 24 17:57:42.393415 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-cf61754f-eb51-47c9-97a3-e752240c16ce req-f2108cad-5ff5-437a-8a4b-bf13fec57a77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Aug 24 17:57:42.394145 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 596/1208] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:42.843151 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:42.843762 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:42.849865 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:42.850341 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:42.850773 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:42.851452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:42.851900 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:42.852319 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:42.979482 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:42.986950 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-7b6e4edd-0568-47a6-ba36-16fae540b712 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.147724 Aug 24 17:57:42.987509 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 613/1209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:42 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:44.008761 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:44.009455 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:44.015607 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:44.016091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:44.016526 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:44.017292 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:44.017742 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:44.018162 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:44.144615 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:44.152747 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-16027332-afac-43c8-be53-22d08d7d94de tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.148915 Aug 24 17:57:44.153305 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 597/1210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:44 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:45.173302 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:45.173909 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:45.176210 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=2 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:45.181606 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:45.182085 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:45.182516 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:45.183205 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:45.183653 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:45.184071 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:45.383747 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:45.391709 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f3e422e9-3f82-40eb-be38-d1beb07bee31 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.222234 Aug 24 17:57:45.392286 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 614/1211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:45 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:46.413546 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:46.414160 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:46.420471 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:46.420972 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:46.421398 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:46.422078 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:46.422523 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:46.422941 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:46.547815 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:46.555340 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-7ee0c2b4-5073-43bc-911c-0715a4aa5b4b tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.145690 Aug 24 17:57:46.555903 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 598/1212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:46 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:47.373558 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc", "name": "network-vif-plugged", "status": "completed", "tag": "cd803fc8-d114-4285-82b7-7e1b8c4a5ba8"}]} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:47.383830 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:47.384387 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:47.384912 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:47.395825 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.compute.server_external_events [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] Creating event network-vif-plugged:cd803fc8-d114-4285-82b7-7e1b8c4a5ba8 for instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc on hv-cinder-83538 Aug 24 17:57:47.401074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [req-c032c80c-5b11-4f92-ad70-6c39aadc1af5 req-d1413256-a12d-4f0c-8286-b462336f8197 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031219 Aug 24 17:57:47.401803 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 615/1213] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:47.576355 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:47.577100 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:47.583913 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:47.584634 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:47.585067 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:47.585760 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:47.586204 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:47.586623 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:47.715401 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:47.723297 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-40750387-32d2-404a-aa98-735adfc958ea tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.150815 Aug 24 17:57:47.723855 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 599/1214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:47 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:48.746020 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:48.746722 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:48.753364 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:48.753844 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:48.754281 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:48.754977 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:48.755442 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:48.756138 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:48.881611 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:48.889082 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-f314a145-e4c5-4080-8264-d6c66b26b48c tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1319 microversion: 2.1 time: 0.147763 Aug 24 17:57:48.889635 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 616/1215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:48 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:49.909483 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:49.910091 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:49.912028 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell0:SELECT=4 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:49.917580 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:49.918056 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:49.918494 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:49.919182 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:49.919637 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:49.920060 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:50.047237 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:50.055299 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-98d4334d-19bf-456e-a604-7c131a45cdac tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1508 microversion: 2.1 time: 0.149637 Aug 24 17:57:50.055795 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 600/1216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:49 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:50.076019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4484f561-9fb2-4dde-abe6-2d35ec8b3f19", "device": "/dev/sdb"}} {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:50.078501 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:50.080409 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell0:SELECT=10 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:50.086452 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:50.086928 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:50.087357 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:50.088041 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:50.088494 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:50.088943 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:50.316010 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-10f4cb93-0e17-4a13-8470-5b5db1dd20be tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "POST /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243785 Aug 24 17:57:50.316589 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 617/1217] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 17:57:50 2022] POST /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:10.642246 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:10.642869 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:10.644898 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_api:SELECT=20 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:10.645716 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG dbcounter [-] [127239] Writing DB stats nova_cell1:SELECT=32 {{(pid=127239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:10.652630 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:10.653138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:10.653581 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:10.654278 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:10.654737 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:10.655166 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:10.734077 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.objects.instance [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lazy-loading 'services' on Instance uuid 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc {{(pid=127239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:58:10.805309 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-dfec8c1a-995b-4e75-8b26-3cc973d3e944 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc/os-volume_attachments/4484f561-9fb2-4dde-abe6-2d35ec8b3f19" status: 202 len: 0 microversion: 2.1 time: 0.166735 Aug 24 17:58:10.806192 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 601/1218] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 17:58:10 2022] DELETE /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc/os-volume_attachments/4484f561-9fb2-4dde-abe6-2d35ec8b3f19 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:11.922917 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:11.923739 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG dbcounter [-] [127241] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:11.927709 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:11.928293 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:11.935757 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.936229 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.936697 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.937390 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.937840 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.938270 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.964716 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Going to try to terminate instance {{(pid=127241) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:12.043615 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-d703124a-a8c6-49db-be3f-88150c977076 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 204 len: 0 microversion: 2.1 time: 0.121685 Aug 24 17:58:12.044345 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 618/1219] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:11 2022] DELETE /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:58:12.053458 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:12.054138 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:12.061753 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.062286 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.062942 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.063748 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.064207 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.064794 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.192366 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.policy [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:12.200670 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-5c87b739-5e3d-4691-ad92-cc7bf62fc917 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1514 microversion: 2.1 time: 0.151440 Aug 24 17:58:12.201239 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 602/1220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:12 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:13.222917 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:13.223673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:13.230763 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:13.231241 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:13.231673 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:13.232360 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:13.232850 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:13.233273 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:13.359153 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:13.366864 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-32a84439-20d0-45f9-aec9-70dcef82eb12 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1514 microversion: 2.1 time: 0.148232 Aug 24 17:58:13.367425 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 619/1221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:13 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:14.297361 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc", "name": "network-vif-deleted", "tag": "cd803fc8-d114-4285-82b7-7e1b8c4a5ba8"}]} {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:14.310579 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.311062 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.311495 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.326043 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.compute.server_external_events [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] Creating event network-vif-deleted:cd803fc8-d114-4285-82b7-7e1b8c4a5ba8 for instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc on hv-cinder-83538 Aug 24 17:58:14.331557 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [req-1eeb283d-f577-4a95-b4b9-c78833b76f3d req-3b126c7a-7696-4847-9a83-1289b8219696 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038129 Aug 24 17:58:14.332338 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 603/1222] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:14.388429 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.api.openstack.wsgi [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:14.389074 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.compute.api [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127241) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:14.395534 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.396573 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.397013 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.397718 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.398392 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.398818 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.429386 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.429861 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.430291 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG oslo_concurrency.lockutils [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.430741 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.objects.instance [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lazy-loading 'fault' on Instance uuid 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc {{(pid=127241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:58:14.471306 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: DEBUG nova.policy [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2df13f963549078f92b91cf21da2f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a389d974a9c465f8f5a8204b77be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127241) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:14.478888 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO nova.api.openstack.requestlog [None req-04659708-e184-415a-93ef-42da883a5d4e tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 200 len: 1309 microversion: 2.1 time: 0.094331 Aug 24 17:58:14.479444 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: [pid: 127241|app: 0|req: 620/1223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:14 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:15.500977 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Calling method '>' {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:15.501678 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.compute.api [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] [instance: 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc] Fetching instance by UUID {{(pid=127239) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:15.508428 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:15.508935 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:15.509375 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:15.510058 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Acquiring lock "d6f79d34-d459-413a-9a07-4219ab368fd7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:15.510514 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:15.510938 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG oslo_concurrency.lockutils [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Lock "d6f79d34-d459-413a-9a07-4219ab368fd7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:15.524377 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.wsgi [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] HTTP exception thrown: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Request method failure captured: Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: request: GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc HTTP/1.1 Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept: application/json Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Accept-Encoding: identity Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Connection: close Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Length: 0 Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Content-Type: application/json Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Host: 10.222.0.45 Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Openstack-System-Scope: None Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Auth-Token: gAAAAABjBmZBwX_rjb291mHs45IvwoZ2ylf3aEpkDwLI_JV_B3vhe4DG-qWKAzYbag35JHyhNQabzgKn_rbY_f8Sosg7qOqVG1fZfmnLX-rdvKFG1bAJZbzPJhn7me6utSmalbAIzDznxpksX9ZWJq1FKGYLLyk_zuwd_aDPrZ2CP5KWvRoMSlc Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Id: None Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Domain-Name: None Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Identity-Status: Confirmed Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Is-Admin-Project: True Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Id: default Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Domain-Name: Default Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Id: 0a389d974a9c465f8f5a8204b77be62b Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Role: reader,member Aug 24 17:58:15.525987 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Roles: reader,member Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0a389d974a9c465f8f5a8204b77be62b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}] Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Id: 0a389d974a9c465f8f5a8204b77be62b Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1457338015 Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User: tempest-VolumesSnapshotTestJSON-1457338015-project Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Id: default Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Domain-Name: Default Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Id: fa2df13f963549078f92b91cf21da2f0 Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: X-User-Name: tempest-VolumesSnapshotTestJSON-1457338015-project Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: method: > Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: exception: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. Aug 24 17:58:15.527768 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: action_args: {'id': '3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc'} Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: {{(pid=127239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:15.528947 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. Aug 24 17:58:15.530680 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: ERROR nova.api.openstack.wsgi Aug 24 17:58:15.532270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: DEBUG nova.api.openstack.wsgi [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] Returning 404 to user: Instance 3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc could not be found. {{(pid=127239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:15.532270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO nova.api.openstack.requestlog [None req-6447db71-2a48-4b4a-b4bd-4e320fb4e137 tempest-VolumesSnapshotTestJSON-1457338015 tempest-VolumesSnapshotTestJSON-1457338015-project] 10.222.0.45 "GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc" status: 404 len: 111 microversion: 2.1 time: 0.030612 Aug 24 17:58:15.532270 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: [pid: 127239|app: 0|req: 604/1224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:15 2022] GET /compute/v2.1/servers/3bb3051f-3c64-4a61-b2b9-f3b4283cb5bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:21.981354 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:00:21.981980 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Wed Aug 24 18:00:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:00:24.945525 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 24 18:00:27.393019 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:00:27.393626 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Wed Aug 24 18:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:00:30.533717 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:00:30.534296 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Wed Aug 24 18:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:00:39.281140 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 24 18:00:39.281801 dv-cinder-835384-24-iscsi devstack@n-api.service[127239]: Wed Aug 24 18:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:00:53.271746 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 24 18:02:54.948730 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 24 18:02:54.949348 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Wed Aug 24 18:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:03:23.274897 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 24 18:03:23.275726 dv-cinder-835384-24-iscsi devstack@n-api.service[127241]: Wed Aug 24 18:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!